-- Logs begin at Thu 2022-09-01 15:49:54 UTC, end at Thu 2022-09-01 17:12:21 UTC. -- Sep 01 16:25:13.329473 dv-cinder-852210-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 16:25:13.336945 dv-cinder-852210-9-smb devstack@keystone.service[81827]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 16:25:13.338930 dv-cinder-852210-9-smb devstack@keystone.service[81827]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:25:13 2022] *** Sep 01 16:25:13.338930 dv-cinder-852210-9-smb devstack@keystone.service[81827]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:25:13.338930 dv-cinder-852210-9-smb devstack@keystone.service[81827]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:25:13.338930 dv-cinder-852210-9-smb devstack@keystone.service[81827]: nodename: dv-cinder-852210-9-smb Sep 01 16:25:13.338930 dv-cinder-852210-9-smb devstack@keystone.service[81827]: machine: x86_64 Sep 01 16:25:13.338930 dv-cinder-852210-9-smb devstack@keystone.service[81827]: clock source: unix Sep 01 16:25:13.338930 dv-cinder-852210-9-smb devstack@keystone.service[81827]: pcre jit disabled Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: detected number of CPU cores: 4 Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: current working directory: / Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: your processes number limit is 47680 Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: your memory page size is 4096 bytes Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: detected max file descriptor number: 2048 Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: lock engine: pthread robust mutexes Sep 01 16:25:13.339410 dv-cinder-852210-9-smb devstack@keystone.service[81827]: thunder lock: enabled Sep 01 16:25:13.344464 dv-cinder-852210-9-smb devstack@keystone.service[81827]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 16:25:13.344464 dv-cinder-852210-9-smb devstack@keystone.service[81827]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:25:13.380814 dv-cinder-852210-9-smb devstack@keystone.service[81827]: Python main interpreter initialized at 0x55e1bea699c0 Sep 01 16:25:13.380814 dv-cinder-852210-9-smb devstack@keystone.service[81827]: python threads support enabled Sep 01 16:25:13.380814 dv-cinder-852210-9-smb devstack@keystone.service[81827]: your server socket listen backlog is limited to 100 connections Sep 01 16:25:13.380814 dv-cinder-852210-9-smb devstack@keystone.service[81827]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:25:13.381167 dv-cinder-852210-9-smb devstack@keystone.service[81827]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:25:13.381259 dv-cinder-852210-9-smb devstack@keystone.service[81827]: *** Operational MODE: preforking *** Sep 01 16:25:13.381534 dv-cinder-852210-9-smb devstack@keystone.service[81827]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:25:13.381534 dv-cinder-852210-9-smb devstack@keystone.service[81827]: spawned uWSGI master process (pid: 81827) Sep 01 16:25:13.381736 dv-cinder-852210-9-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 16:25:13.383636 dv-cinder-852210-9-smb devstack@keystone.service[81827]: spawned uWSGI worker 1 (pid: 81830, cores: 1) Sep 01 16:25:13.383636 dv-cinder-852210-9-smb devstack@keystone.service[81827]: spawned uWSGI worker 2 (pid: 81831, cores: 1) Sep 01 16:25:13.383636 dv-cinder-852210-9-smb devstack@keystone.service[81827]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:25:17.734760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:17.734760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: from cryptography.utils import int_from_bytes Sep 01 16:25:17.735565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:17.735565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: from cryptography.utils import int_from_bytes Sep 01 16:25:17.735870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:17.735870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: from cryptography.utils import int_from_bytes Sep 01 16:25:17.736328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:17.736328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: from cryptography.utils import int_from_bytes Sep 01 16:25:17.786412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:25:17.786602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:25:17.786793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] command line args: [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:25:17.787060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:25:17.787257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ================================================================================ {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:25:17.787510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] admin_token = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.787749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] config_dir = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.787932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.788162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] config_source = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.788250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:25:17.788326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] debug = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.788402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:25:17.788487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.788737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] command line args: [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:25:17.788860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:25:17.788935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ================================================================================ {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:25:17.789138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] admin_token = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] config_dir = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] list_limit = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] log_config_append = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.789997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] config_source = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] debug = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] log_dir = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] log_file = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.790895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] list_limit = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] log_config_append = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.791999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] log_dir = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] log_file = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.792941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.793891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] publish_errors = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.794998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] standard_threads = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.795972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] publish_errors = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] use_journal = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.796979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] use_json = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.797090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.797214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] use_stderr = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.797214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] use_syslog = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.797427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.797540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.797652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.797770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.797894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] standard_threads = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.798015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.798148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.798261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.798380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.798380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.798608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.798728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] use_journal = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.798848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.798962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] use_json = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.799081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.799218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] use_stderr = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.799218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] use_syslog = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.799522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.799636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:17.799749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.799942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.800897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.801946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.802992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803735 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.803962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804316 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.804913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.805101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.805218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.805461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.805578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.805681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.805796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.805917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.806953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.807897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.808958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.809976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.810958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.811924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.812921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.813975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.814954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.815056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.815180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.817939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.818949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819119 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.819969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.820047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.820121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.820707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.820787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.820912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.820990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.821976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.822886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.823012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.823353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] auth.external = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.823646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.823730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.823803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.823881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.823964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824112 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] auth.password = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] auth.token = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.824903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] auth.external = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] credential.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.825934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] auth.password = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] auth.token = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.826986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] credential.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.827986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.828988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.829979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.830997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.831980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.832920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.833919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.834179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.834310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.834427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.834544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.834668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.834785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.834900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.835015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.835132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.835300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.835430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.835548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.835663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.835778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.836501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.836629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.836768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.836892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.837951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838190 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.838899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.839998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.840957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.841951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.842942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.843040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.843137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.843371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.845812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.845923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.846959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847203 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.847931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.848956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.849996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.850958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.851061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.851142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.851377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.851568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.851664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.851810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.851892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.852990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853316 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.853943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] role.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.854970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] role.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.855934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.856893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.857889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] role.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] role.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.858939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.859938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.860902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.861979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.862059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.862226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.862307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.862487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.862697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.862820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.862943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.863973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.864929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.865880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.866984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.connection = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.867997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.868938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869020 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.869982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.870924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.871034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.874484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.874598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.874681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.874755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.874828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.connection = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.874902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.874983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.875900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:17.876319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:25:17.902341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.902514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.902752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.905720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.905954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.906181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.911044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.914930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.943527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.943751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.944824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:17.945065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.004808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.005005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.055200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.055432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.055828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.056067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.224958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.224958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225513 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.225814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.247113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.247319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.247408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.247555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.247655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.247781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.247865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.248003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.248086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.248215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.248301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.248424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.248507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.248631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.260056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.260175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.279439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.279671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.279887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.279972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81831) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.280955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.281176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:25:18.297779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.297989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:25:18.298244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.298334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.298456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:25:18.298548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:25:18.298786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.298983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:25:18.299118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.299278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.299365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.299556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.299653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.299814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.299895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.300070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.309725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.310005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.310277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.310402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.310553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.310637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.310820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.311103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.317546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.318150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.320485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.320772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.323469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.323873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.324788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.345820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.346527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.347381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.347667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.348036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.348343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.360805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.360805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.360948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.361010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.361084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.361084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.361233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.361233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.361371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.361371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.364258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.364554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.364639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.364836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.364921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.365118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.365230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.365407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.365522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.365683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.365768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.365956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.366227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.367806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.368094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.368380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.383765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.384046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.384298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.384575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.388315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.388463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.391191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.391497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.391626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.391886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.395716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.396232 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.400734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.400817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.402373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.402675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.402856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.403001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.403169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.403365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.403451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.403657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.403754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.403940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.404032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.404346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.420276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.420566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.420836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.421110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.421510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.423719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.423719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.423719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.427966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.429037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.429496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.431623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.431716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.431903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.433158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.433434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.434662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.434948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.435259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.435544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.435840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.436105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.436390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.436670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.436951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.437243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.448052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.448347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.448636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.448921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.449204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.449496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.449785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.450968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.451358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.451592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.451871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.452154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.452669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.453060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.467198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.469834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.470103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.471838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.473011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.474574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.474725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.476143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.476250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.476385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.477252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.478256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.478549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.478842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.483660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.485256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.485981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.487490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.492810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.492810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.492810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.492810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.493066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.493066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.493066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.493066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.497506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.497795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.498078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.499759 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.500048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.500327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.504893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81831) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.505178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.505461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.505738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.506015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.506294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.506578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.506853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.507229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:25:18.507314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.507517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.507598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.507841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.507925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.508119 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.508200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.508393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.508481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.508673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.508756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81831) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.508959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.509235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.509514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.509788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.510083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.510339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.510603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.510876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:25:18.543407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e1bea699c0 pid: 81831 (default app) Sep 01 16:25:18.545634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e1bea699c0 pid: 81830 (default app) Sep 01 16:25:18.546846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095bdb-df09-4504-b64f-543939e968df None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:18.547241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095bdb-df09-4504-b64f-543939e968df None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:18.547599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095bdb-df09-4504-b64f-543939e968df None None] PATH_INFO: `/v3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:18.551907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Thu Sep 1 16:25:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:25.873221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d701c4-81c5-465a-b7c7-b27d663ec7da None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:25.873722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d701c4-81c5-465a-b7c7-b27d663ec7da None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:25.873803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d701c4-81c5-465a-b7c7-b27d663ec7da None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:25.878043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:25.883666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:25.884072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:25.884206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:25.954160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: INFO dbcounter [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] Registered counter for database keystone Sep 01 16:25:25.973274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG oslo_db.sqlalchemy.engines [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:25.979497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writer thread running {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:26.156700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG passlib.handlers.bcrypt [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81831) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:25:26.157091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG passlib.handlers.bcrypt [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81831) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:25:26.215236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:26.218288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:26.349359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 16:25:26.818277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d701c4-81c5-465a-b7c7-b27d663ec7da None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:26.887427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: INFO dbcounter [None req-b9d701c4-81c5-465a-b7c7-b27d663ec7da None None] Registered counter for database keystone Sep 01 16:25:26.909107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d701c4-81c5-465a-b7c7-b27d663ec7da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:26.915920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writer thread running {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:27.032320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d701c4-81c5-465a-b7c7-b27d663ec7da None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:27.036450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f9e4-3e1c-4393-bfdb-dfeb9a1112f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:27.037069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f9e4-3e1c-4393-bfdb-dfeb9a1112f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:27.037342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f9e4-3e1c-4393-bfdb-dfeb9a1112f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:27.037610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f9e4-3e1c-4393-bfdb-dfeb9a1112f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:27.045660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f9e4-3e1c-4393-bfdb-dfeb9a1112f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:27.096412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7997f9e4-3e1c-4393-bfdb-dfeb9a1112f7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:25:27.096747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f9e4-3e1c-4393-bfdb-dfeb9a1112f7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:27.105964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Thu Sep 1 16:25:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:25:27.111924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:27.126565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14120b-2b7f-47ed-80e4-6ddb065eccf6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:27.130911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c09b4-b96a-414b-8896-38b4207523c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:27.132037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c09b4-b96a-414b-8896-38b4207523c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:27.132963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c09b4-b96a-414b-8896-38b4207523c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:27.133242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c09b4-b96a-414b-8896-38b4207523c0 admin admin] PATH_INFO: `/v3/projects/17429cdb686a41f6a3cf51eb7ac21844` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:27.134819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c09b4-b96a-414b-8896-38b4207523c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=17429cdb686a41f6a3cf51eb7ac21844)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:27.186457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c53c09b4-b96a-414b-8896-38b4207523c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:25:27.186751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c09b4-b96a-414b-8896-38b4207523c0 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:27.191340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Thu Sep 1 16:25:27 2022] GET /identity/v3/projects/17429cdb686a41f6a3cf51eb7ac21844 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:29.066978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27073-5a79-4763-899e-a016526c984e None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:29.067544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27073-5a79-4763-899e-a016526c984e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:29.067544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27073-5a79-4763-899e-a016526c984e None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:29.072190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:29.077385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e06d8-cffb-4d88-8534-415511a0eb92 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:29.077830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e06d8-cffb-4d88-8534-415511a0eb92 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:29.077924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e06d8-cffb-4d88-8534-415511a0eb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:29.098170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-181e06d8-cffb-4d88-8534-415511a0eb92 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:29.099718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-181e06d8-cffb-4d88-8534-415511a0eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:29.107462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 01 16:25:29.372867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27073-5a79-4763-899e-a016526c984e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:29.385363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27073-5a79-4763-899e-a016526c984e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:29.389592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba4b98-a483-4276-b007-3d04edd4d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:29.390186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba4b98-a483-4276-b007-3d04edd4d1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:29.390465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba4b98-a483-4276-b007-3d04edd4d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:29.390736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba4b98-a483-4276-b007-3d04edd4d1f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:29.398551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba4b98-a483-4276-b007-3d04edd4d1f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:29.400326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba4b98-a483-4276-b007-3d04edd4d1f8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:29.408977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Thu Sep 1 16:25:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:25:29.414278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e06d8-cffb-4d88-8534-415511a0eb92 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:29.423221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e06d8-cffb-4d88-8534-415511a0eb92 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:29.427485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a248d-5c29-42ad-bb4d-84be787d47fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:29.428093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a248d-5c29-42ad-bb4d-84be787d47fa admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:29.428368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a248d-5c29-42ad-bb4d-84be787d47fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:29.428635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a248d-5c29-42ad-bb4d-84be787d47fa admin admin] PATH_INFO: `/v3/users/767c0fa425fc4873b22c5fadbfb7d673` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:29.430428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a248d-5c29-42ad-bb4d-84be787d47fa admin admin] RBAC: Authorizing `identity:get_user(user_id=767c0fa425fc4873b22c5fadbfb7d673)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:29.432277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a248d-5c29-42ad-bb4d-84be787d47fa admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:29.433775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Thu Sep 1 16:25:29 2022] GET /identity/v3/users/767c0fa425fc4873b22c5fadbfb7d673 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:31.383665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad9635-5c1a-4161-96a1-59637542b4b9 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.384236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad9635-5c1a-4161-96a1-59637542b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.384569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad9635-5c1a-4161-96a1-59637542b4b9 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.386281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:31.391676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe2509-5a03-451a-bb51-a01aeaba6d9c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.392156 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe2509-5a03-451a-bb51-a01aeaba6d9c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.392249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe2509-5a03-451a-bb51-a01aeaba6d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.410892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-17fe2509-5a03-451a-bb51-a01aeaba6d9c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:31.412113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-17fe2509-5a03-451a-bb51-a01aeaba6d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:31.433118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe628bc0-b656-452c-9665-95259ed7ce4a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.433410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe628bc0-b656-452c-9665-95259ed7ce4a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.433686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe628bc0-b656-452c-9665-95259ed7ce4a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.435003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:31.440085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.440371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.440646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.482267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG passlib.handlers.bcrypt [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81830) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:25:31.482660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG passlib.handlers.bcrypt [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81830) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:25:31.490832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:31.532099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:31.533694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:31.633825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:31.762061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe2509-5a03-451a-bb51-a01aeaba6d9c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:31.785816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:31.867964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe2509-5a03-451a-bb51-a01aeaba6d9c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:31.900500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:31.901065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:31.901348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:31.901622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:31.903561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:31.914385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:31.923019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:31.923985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:31.924795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 7/14] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:25:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:31.931810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:32.002110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7673c7-d190-4195-9712-03b0e06edbaf None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:32.004407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.012223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.030749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b811-21a8-4310-bc4b-5a74836fe21a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:32.041781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:32.042640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:32.042920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:32.043217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:32.064468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:32.065073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:32.065349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:32.065617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:32.066275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:32.066574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.068044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.080016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 8/15] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:32.086641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:32.111852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.113376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.184319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8e36-aaa4-424c-93cb-0f4eed47e9fe None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:32.209795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:32.215834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:32.218038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:32.218518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.218647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:32.218930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:32.219662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] PATH_INFO: `/v3/users/767c0fa425fc4873b22c5fadbfb7d673` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:32.220827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] RBAC: Authorizing `identity:get_user(user_id=767c0fa425fc4873b22c5fadbfb7d673)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.222279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.223950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 9/17] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:32 2022] GET /identity/v3/users/767c0fa425fc4873b22c5fadbfb7d673 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:32.229435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:32.244616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.316162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99102c48-cda1-4e79-bbef-69e7673f0811 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:32.334889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039620f7-334c-4adb-a8e2-b11bb3ff1666 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:32.350102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:32.351692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:32.352100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:32.352505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:32.368501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:32.369117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:32.369389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:32.369656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:32.370759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.372174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.372290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.373618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.373796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 10/18] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:32.379656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:25:32.392002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:32.393372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:25:32.394174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:25:32.394174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:25:32.394174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:32.394174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 9/19] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:25:32.399270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:32.454063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.461111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.479717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c8c2d-f7d3-453e-9b10-c33aedaf88ce None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:32.498439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db9e4-35ad-4e63-8cfc-25bed48c0a29 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:32.512956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e6684-9de6-4bd5-a42a-851737c1b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:32.513576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e6684-9de6-4bd5-a42a-851737c1b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:32.514114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e6684-9de6-4bd5-a42a-851737c1b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:32.514432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e6684-9de6-4bd5-a42a-851737c1b1d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:32.515372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e6684-9de6-4bd5-a42a-851737c1b1d5 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.domain.id=default, user.id=767c0fa425fc4873b22c5fadbfb7d673) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:32.515727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e6684-9de6-4bd5-a42a-851737c1b1d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.517582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e6684-9de6-4bd5-a42a-851737c1b1d5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.524381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 11/20] 10.222.0.69 () {56 vars in 1322 bytes} [Thu Sep 1 16:25:32 2022] GET /identity/v3/role_assignments?user.id=767c0fa425fc4873b22c5fadbfb7d673&scope.domain.id=default&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:32.532221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71e8aa-c5f6-4415-a178-80f59d79eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:32.532972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e8aa-c5f6-4415-a178-80f59d79eb9b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:32.533319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e8aa-c5f6-4415-a178-80f59d79eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:32.533595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e8aa-c5f6-4415-a178-80f59d79eb9b None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:32.534263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71e8aa-c5f6-4415-a178-80f59d79eb9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:32.534562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71e8aa-c5f6-4415-a178-80f59d79eb9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:32.536032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71e8aa-c5f6-4415-a178-80f59d79eb9b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:32.556483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 10/21] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:34.619353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4719367-ed44-4c4e-98e0-8284b7c1bd53 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.620410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4719367-ed44-4c4e-98e0-8284b7c1bd53 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.620897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4719367-ed44-4c4e-98e0-8284b7c1bd53 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.622453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 12/22] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:34.628101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d5a0-3179-4b8e-9b93-1bb029a801e0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.628947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d5a0-3179-4b8e-9b93-1bb029a801e0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.629428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d5a0-3179-4b8e-9b93-1bb029a801e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.653027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9a54d5a0-3179-4b8e-9b93-1bb029a801e0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:34.653376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9a54d5a0-3179-4b8e-9b93-1bb029a801e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:34.767104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 11/23] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:35.074327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c17d0-7b63-4e03-894b-44da607ef1fa None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.075007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c17d0-7b63-4e03-894b-44da607ef1fa None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.075537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c17d0-7b63-4e03-894b-44da607ef1fa None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.077124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:35.082416 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ef7b-b4c6-402e-90de-e9b9915f6e92 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.082922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ef7b-b4c6-402e-90de-e9b9915f6e92 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.083413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ef7b-b4c6-402e-90de-e9b9915f6e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.107827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-34a1ef7b-b4c6-402e-90de-e9b9915f6e92 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:35.109328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-34a1ef7b-b4c6-402e-90de-e9b9915f6e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:35.161163 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.192978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 12/25] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:35.304485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c17d0-7b63-4e03-894b-44da607ef1fa None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:35.361545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c5ac-985c-4677-b783-1dbebfef6ab2 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.361545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c5ac-985c-4677-b783-1dbebfef6ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.361545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c5ac-985c-4677-b783-1dbebfef6ab2 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.361545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 13/26] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:35.371347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d249-60b7-41c2-b610-4d3d35ffb1e1 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.371864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d249-60b7-41c2-b610-4d3d35ffb1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.372336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d249-60b7-41c2-b610-4d3d35ffb1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.412844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c17d0-7b63-4e03-894b-44da607ef1fa None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:35.414680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6f60d249-60b7-41c2-b610-4d3d35ffb1e1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:35.416058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6f60d249-60b7-41c2-b610-4d3d35ffb1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:35.456929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed723a5-68bc-4387-a31a-432a2f7939a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:35.457786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723a5-68bc-4387-a31a-432a2f7939a3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.458233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723a5-68bc-4387-a31a-432a2f7939a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.458646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723a5-68bc-4387-a31a-432a2f7939a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.470268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed723a5-68bc-4387-a31a-432a2f7939a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-1ed723a5-68bc-4387-a31a-432a2f7939a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:35.475425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:35.476881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:35.477625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:35.480177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 14/27] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:35.481623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763873e-37a0-42d9-9a35-801f539c3b17 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.482073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763873e-37a0-42d9-9a35-801f539c3b17 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.482599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763873e-37a0-42d9-9a35-801f539c3b17 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.484056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 15/28] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:35.492196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a597a-4f0a-408a-952e-b13eb63d6aa8 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.492768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a597a-4f0a-408a-952e-b13eb63d6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.493246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a597a-4f0a-408a-952e-b13eb63d6aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.505897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.518440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8d8a597a-4f0a-408a-952e-b13eb63d6aa8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:35.527848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8d8a597a-4f0a-408a-952e-b13eb63d6aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:35.537653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 14/29] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:35.538663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d249-60b7-41c2-b610-4d3d35ffb1e1 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:35.622736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 16/30] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:35.624362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a597a-4f0a-408a-952e-b13eb63d6aa8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:35.660011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d249-60b7-41c2-b610-4d3d35ffb1e1 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:35.674057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.719930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:35.721179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.727593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.727897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.728645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:35.728953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:35.730368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:35.750802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 15/31] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:35.756278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:35.814902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a597a-4f0a-408a-952e-b13eb63d6aa8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:35.875926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:35.876486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.876769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.877030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.879023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.890079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:35.891009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:25:35.913126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:35.914572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:25:35.915405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:25:35.915405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:25:35.915405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:35.917188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 17/32] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:35.918162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:35.965978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b43489-49f0-4e3f-b0af-0a7bbead2737 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:36.032200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:36.032559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.032816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.033098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] PATH_INFO: `/v3/users/767c0fa425fc4873b22c5fadbfb7d673` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.040257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] RBAC: Authorizing `identity:get_user(user_id=767c0fa425fc4873b22c5fadbfb7d673)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:36.042081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:36.044042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 16/33] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:35 2022] GET /identity/v3/users/767c0fa425fc4873b22c5fadbfb7d673 => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:36.044835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:36.046324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81f16-7212-49b7-98aa-476f79b5756a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:36.084550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:36.086101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.086790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:36.087659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.088294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.089176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:36.090827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:36.154574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc811c-839e-4f63-9b9e-f66d46534a42 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:36.189202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:36.189810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.190087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.190357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.191135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:36.191465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:36.192833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:36.211030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 17/34] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:36.211889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:36.309262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:36.309742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 18/35] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 1 16:25:35 2022] POST /identity/v3/roles => generated 225 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:36.310745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:36.317049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181022e4-0777-4c59-aa88-ae611e88ae64 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:36.358727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be242-db1d-4f52-884f-b8d102c587f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:36.359691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be242-db1d-4f52-884f-b8d102c587f6 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.360147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be242-db1d-4f52-884f-b8d102c587f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.360592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be242-db1d-4f52-884f-b8d102c587f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.361577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be242-db1d-4f52-884f-b8d102c587f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:36.363321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be242-db1d-4f52-884f-b8d102c587f6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:36.370646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:36.432185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3305-ce28-4902-ad6b-aa87899b1a52 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:36.473291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:36.474002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.474291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.474566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.477370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:36.479042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:36.481030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 19/36] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:36.481850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:36.555968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 1 16:25:36 2022] POST /identity/v3/roles => generated 219 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:36.557421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17db60-ab92-481f-b59f-0fdef05d3259 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.557741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17db60-ab92-481f-b59f-0fdef05d3259 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.557987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17db60-ab92-481f-b59f-0fdef05d3259 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.559452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 19/38] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:36.560809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17db60-ab92-481f-b59f-0fdef05d3259 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:36.589693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be25c-bb27-40ad-8ed6-13fb03f0bee5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:36.606806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:36.631309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8190e-3351-4dfe-9fb1-977714415d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:36.632067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8190e-3351-4dfe-9fb1-977714415d55 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.632523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8190e-3351-4dfe-9fb1-977714415d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.632904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8190e-3351-4dfe-9fb1-977714415d55 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.634292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8190e-3351-4dfe-9fb1-977714415d55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:36.635879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8190e-3351-4dfe-9fb1-977714415d55 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:36.683908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17db60-ab92-481f-b59f-0fdef05d3259 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:36.721396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ca2c8-7d4c-451b-a1de-04c431288281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:36.722059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ca2c8-7d4c-451b-a1de-04c431288281 None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.722338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ca2c8-7d4c-451b-a1de-04c431288281 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.722614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ca2c8-7d4c-451b-a1de-04c431288281 None admin] PATH_INFO: `/v3/domains/default/users/767c0fa425fc4873b22c5fadbfb7d673/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.724793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ca2c8-7d4c-451b-a1de-04c431288281 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=767c0fa425fc4873b22c5fadbfb7d673, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:36.726538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ca2c8-7d4c-451b-a1de-04c431288281 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:36.735010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 20/39] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:25:36 2022] POST /identity/v3/projects => generated 301 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:36.736512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b89800-3163-4400-bb68-8b2ea5038f5c None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.736812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b89800-3163-4400-bb68-8b2ea5038f5c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.737133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b89800-3163-4400-bb68-8b2ea5038f5c None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.738389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 21/40] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:36.740644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5eac-0aea-438c-b7ce-5905afaae4b7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.740915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5eac-0aea-438c-b7ce-5905afaae4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.741720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5eac-0aea-438c-b7ce-5905afaae4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.762698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-420b5eac-0aea-438c-b7ce-5905afaae4b7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:36.764337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-420b5eac-0aea-438c-b7ce-5905afaae4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:36.817230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 20/41] 10.222.0.69 () {58 vars in 1361 bytes} [Thu Sep 1 16:25:36 2022] PUT /identity/v3/domains/default/users/767c0fa425fc4873b22c5fadbfb7d673/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:25:36.818413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b099f-0a3e-4150-8785-f332fc2dc3a3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:36.818708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b099f-0a3e-4150-8785-f332fc2dc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:36.819079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b099f-0a3e-4150-8785-f332fc2dc3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:36.852031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 22/42] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:36.852245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1a9b099f-0a3e-4150-8785-f332fc2dc3a3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:36.854060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1a9b099f-0a3e-4150-8785-f332fc2dc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:36.869955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:36.941764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 21/43] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:37.122849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5eac-0aea-438c-b7ce-5905afaae4b7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:37.212035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b099f-0a3e-4150-8785-f332fc2dc3a3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:37.317579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b099f-0a3e-4150-8785-f332fc2dc3a3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:37.326926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:37.333623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5eac-0aea-438c-b7ce-5905afaae4b7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:37.354004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:37.354646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:37.354926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:37.355221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:37.356536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:37.358165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:37.359592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 22/44] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:37.364917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:37.369822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20199711-5e27-4e79-8e37-0db4ae9d43ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:37.370439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20199711-5e27-4e79-8e37-0db4ae9d43ca None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:37.370720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20199711-5e27-4e79-8e37-0db4ae9d43ca None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:37.370996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20199711-5e27-4e79-8e37-0db4ae9d43ca None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:37.371703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20199711-5e27-4e79-8e37-0db4ae9d43ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:37.373101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20199711-5e27-4e79-8e37-0db4ae9d43ca None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:37.381510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:37.446280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 23/45] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 1 16:25:37 2022] POST /identity/v3/roles => generated 223 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:37.472248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bf1c3-6496-4ce0-887d-a575251ba243 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:37.512135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4c343-7b2d-4f8e-b4c8-d7c946cfb56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:37.512766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c343-7b2d-4f8e-b4c8-d7c946cfb56a None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:37.513048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c343-7b2d-4f8e-b4c8-d7c946cfb56a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:37.513326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c343-7b2d-4f8e-b4c8-d7c946cfb56a None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:37.514121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4c343-7b2d-4f8e-b4c8-d7c946cfb56a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:37.515670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4c343-7b2d-4f8e-b4c8-d7c946cfb56a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:37.596604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 23/46] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:25:37 2022] POST /identity/v3/projects => generated 312 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:25:38.737927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd708e-859f-4232-a1ed-db72f02e25c2 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:38.738452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd708e-859f-4232-a1ed-db72f02e25c2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:38.738452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd708e-859f-4232-a1ed-db72f02e25c2 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:38.739854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 24/47] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:38.745605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659676a1-a848-4877-829e-40b62ed89358 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:38.746052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659676a1-a848-4877-829e-40b62ed89358 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:38.746283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659676a1-a848-4877-829e-40b62ed89358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:38.764167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-659676a1-a848-4877-829e-40b62ed89358 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:38.765352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-659676a1-a848-4877-829e-40b62ed89358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:38.824696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:38.831777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 24/48] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:39.103980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd708e-859f-4232-a1ed-db72f02e25c2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:39.203672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd708e-859f-4232-a1ed-db72f02e25c2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:39.240196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:39.240825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.241624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.241903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.252050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:39.257631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:39.258620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:39.259422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 25/49] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:25:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:39.264692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659676a1-a848-4877-829e-40b62ed89358 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:39.361475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659676a1-a848-4877-829e-40b62ed89358 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:39.394281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aa9eb-32d1-4c82-bb73-44f485269565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:39.394884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa9eb-32d1-4c82-bb73-44f485269565 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.395184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa9eb-32d1-4c82-bb73-44f485269565 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.395458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa9eb-32d1-4c82-bb73-44f485269565 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.396124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5aa9eb-32d1-4c82-bb73-44f485269565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:39.396428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5aa9eb-32d1-4c82-bb73-44f485269565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:39.398100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5aa9eb-32d1-4c82-bb73-44f485269565 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:39.406107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 25/50] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:39.412201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:39.431148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:39.513488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced13-ab66-4f9a-88d5-8e5b3be99548 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.513772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced13-ab66-4f9a-88d5-8e5b3be99548 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.514050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced13-ab66-4f9a-88d5-8e5b3be99548 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.515472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 26/51] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:39.518244 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d5d0-580f-46a1-bce2-4260f84f68ed None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:39.520198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de7e44-f882-4cad-b584-1171bd5207b2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.520477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de7e44-f882-4cad-b584-1171bd5207b2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.520750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de7e44-f882-4cad-b584-1171bd5207b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.539422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-37de7e44-f882-4cad-b584-1171bd5207b2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:39.540628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-37de7e44-f882-4cad-b584-1171bd5207b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:39.552280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:39.552913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.553185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.553464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] PATH_INFO: `/v3/users/767c0fa425fc4873b22c5fadbfb7d673` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.555274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] RBAC: Authorizing `identity:get_user(user_id=767c0fa425fc4873b22c5fadbfb7d673)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:39.556733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:39.558308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 26/52] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:39 2022] GET /identity/v3/users/767c0fa425fc4873b22c5fadbfb7d673 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:39.563783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:39.655184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:39.672477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d2c2-390f-42fd-b2ae-b234c039b154 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:39.696563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:39.706603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:39.707328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.707607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.707877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.708945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:39.710560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 27/53] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:39.710958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:39.712548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 27/54] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:39.719999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de7e44-f882-4cad-b584-1171bd5207b2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:39.818192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de7e44-f882-4cad-b584-1171bd5207b2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:39.850838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:39.851484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.851791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.852066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.852789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.domain.id=default, user.id=767c0fa425fc4873b22c5fadbfb7d673) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:39.853098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:39.854566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:39.862698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 28/55] 10.222.0.69 () {56 vars in 1322 bytes} [Thu Sep 1 16:25:39 2022] GET /identity/v3/role_assignments?user.id=767c0fa425fc4873b22c5fadbfb7d673&scope.domain.id=default&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:39.984602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:40.085569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96922c4-bd47-4c9c-b493-c880aad4afb2 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:40.118537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30e93d-9e32-4c95-95d1-49055ded7c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:40.119172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e93d-9e32-4c95-95d1-49055ded7c6e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:40.119477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e93d-9e32-4c95-95d1-49055ded7c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:40.119746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e93d-9e32-4c95-95d1-49055ded7c6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:40.120833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30e93d-9e32-4c95-95d1-49055ded7c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:40.122273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30e93d-9e32-4c95-95d1-49055ded7c6e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:40.123853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 28/56] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:40.129510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:40.181107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:40.224699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e8be-7fba-4f2a-a8e4-5ad8a6ed6985 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:40.258147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fec96-d75d-45d4-9d95-745139b5daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:40.258706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fec96-d75d-45d4-9d95-745139b5daa0 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:40.258984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fec96-d75d-45d4-9d95-745139b5daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:40.259286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fec96-d75d-45d4-9d95-745139b5daa0 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:40.259924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fec96-d75d-45d4-9d95-745139b5daa0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:40.261341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fec96-d75d-45d4-9d95-745139b5daa0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:40.354620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 29/57] 10.222.0.69 () {60 vars in 1140 bytes} [Thu Sep 1 16:25:40 2022] POST /identity/v3/projects => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:42.254212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aafff-0433-4394-9459-d7111c6d9007 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.254724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aafff-0433-4394-9459-d7111c6d9007 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.254805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aafff-0433-4394-9459-d7111c6d9007 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.256146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 29/58] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:42.261830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9d01-ab84-4e12-95ef-82ede5db3637 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.262194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9d01-ab84-4e12-95ef-82ede5db3637 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.262440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9d01-ab84-4e12-95ef-82ede5db3637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.280285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ca9f9d01-ab84-4e12-95ef-82ede5db3637 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:42.281467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ca9f9d01-ab84-4e12-95ef-82ede5db3637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.345388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 30/59] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:42.613645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507aafff-0433-4394-9459-d7111c6d9007 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:42.635957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.713455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507aafff-0433-4394-9459-d7111c6d9007 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:42.745700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f31d7a-5dd5-4db9-a852-df78be79d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:42.746311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31d7a-5dd5-4db9-a852-df78be79d2ec None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.746592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31d7a-5dd5-4db9-a852-df78be79d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.746860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31d7a-5dd5-4db9-a852-df78be79d2ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.747986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f31d7a-5dd5-4db9-a852-df78be79d2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:42.749424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f31d7a-5dd5-4db9-a852-df78be79d2ec None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:42.750957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 30/60] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:42.756402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9d01-ab84-4e12-95ef-82ede5db3637 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:42.789616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.852940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9d01-ab84-4e12-95ef-82ede5db3637 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:42.885446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d897f2c-f20b-4f27-b912-e6e75de287ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:42.885988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897f2c-f20b-4f27-b912-e6e75de287ec None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.886267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897f2c-f20b-4f27-b912-e6e75de287ec None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.886538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897f2c-f20b-4f27-b912-e6e75de287ec None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.887213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d897f2c-f20b-4f27-b912-e6e75de287ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:42.888665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d897f2c-f20b-4f27-b912-e6e75de287ec None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:42.994143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 31/61] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:25:42 2022] POST /identity/v3/users => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:45.978183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbb51-cdc4-4a8f-a69d-1f18a33b5ee8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:45.978683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbb51-cdc4-4a8f-a69d-1f18a33b5ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:45.978683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbb51-cdc4-4a8f-a69d-1f18a33b5ee8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:45.980006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 31/62] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:45.985332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79941b2-9161-4675-93ab-c3ddf36d9f32 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:45.985751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79941b2-9161-4675-93ab-c3ddf36d9f32 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:45.985920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79941b2-9161-4675-93ab-c3ddf36d9f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.008191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c79941b2-9161-4675-93ab-c3ddf36d9f32 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:46.009420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c79941b2-9161-4675-93ab-c3ddf36d9f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.105337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 32/63] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:46.238935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28b8c4-5eae-4e9f-89c2-197e6a87f49d None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.239563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28b8c4-5eae-4e9f-89c2-197e6a87f49d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.240058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28b8c4-5eae-4e9f-89c2-197e6a87f49d None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.242151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 32/64] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:46.247575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b409131-1129-4522-84ff-e724fa597f05 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.248115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b409131-1129-4522-84ff-e724fa597f05 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.248586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b409131-1129-4522-84ff-e724fa597f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.273881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7bc4b-4371-4b4d-a5e3-c4cf5d3ae6e5 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.274470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7bc4b-4371-4b4d-a5e3-c4cf5d3ae6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.274940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7bc4b-4371-4b4d-a5e3-c4cf5d3ae6e5 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.276488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 33/65] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:46.277571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6b409131-1129-4522-84ff-e724fa597f05 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:46.278994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6b409131-1129-4522-84ff-e724fa597f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.286308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962f65-1b0c-4fb5-98df-f16d74b9cad7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.286837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962f65-1b0c-4fb5-98df-f16d74b9cad7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.287348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962f65-1b0c-4fb5-98df-f16d74b9cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.314111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b5962f65-1b0c-4fb5-98df-f16d74b9cad7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:46.317361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b5962f65-1b0c-4fb5-98df-f16d74b9cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.319659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:46.398291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 33/66] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:46.400062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d323d-c1d3-4aca-8143-9c939e5dc3c5 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.400545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d323d-c1d3-4aca-8143-9c939e5dc3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.401032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d323d-c1d3-4aca-8143-9c939e5dc3c5 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.402848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 34/67] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:46.408607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054b1d-5e99-41cb-b4d0-756adf9b8a85 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.409115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054b1d-5e99-41cb-b4d0-756adf9b8a85 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.409692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054b1d-5e99-41cb-b4d0-756adf9b8a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.424868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 34/68] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:46.429492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-41054b1d-5e99-41cb-b4d0-756adf9b8a85 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:46.430884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-41054b1d-5e99-41cb-b4d0-756adf9b8a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.510634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 35/69] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:46.516928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962f65-1b0c-4fb5-98df-f16d74b9cad7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:46.545670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:46.649801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962f65-1b0c-4fb5-98df-f16d74b9cad7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:46.704846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:46.705488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.705768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.706040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.720162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054b1d-5e99-41cb-b4d0-756adf9b8a85 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:46.722530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:46.728586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:46.729442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:46.730340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 35/70] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:46.737735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:46.823144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:46.832257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:46.843490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054b1d-5e99-41cb-b4d0-756adf9b8a85 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:46.853565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ba63-cea3-4730-aa11-a1a57b9d6bfd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:46.877221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:46.877861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.878144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.878420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.887843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:46.888440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.888719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.888991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.889651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:46.889949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:46.890035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:46.891371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:46.896543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:46.898230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:46.898971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 36/71] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:25:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:25:46.900223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:46.905137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 36/72] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:25:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:46.905137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.000472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2a81-c84a-4355-82f4-616dfb70a2fd None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.000983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b91e4-b7ae-4c31-9a89-8d13f244598d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.034574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.034762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dc506-92bf-4985-8a91-ea49995822f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.035223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.035331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dc506-92bf-4985-8a91-ea49995822f9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.035504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.035599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dc506-92bf-4985-8a91-ea49995822f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.035767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.035854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dc506-92bf-4985-8a91-ea49995822f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.043258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.043641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.046502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dc506-92bf-4985-8a91-ea49995822f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:47.047789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-2e2dc506-92bf-4985-8a91-ea49995822f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:47.052768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:47.053593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:47.054353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:47.054923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:47.055741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:47.056582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:47.057146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 37/73] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:47.057211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 37/74] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:47.057211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.059096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21aa6-c803-4a71-ab23-c60a0d727250 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.059405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21aa6-c803-4a71-ab23-c60a0d727250 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.059678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21aa6-c803-4a71-ab23-c60a0d727250 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.061740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 38/75] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:47.061740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e21aa6-c803-4a71-ab23-c60a0d727250 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.157309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c505-620a-458a-8f26-432ded5c9823 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.161927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e21aa6-c803-4a71-ab23-c60a0d727250 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.190276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.190880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.191176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.191466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.192130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:47.192439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.194417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.195731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.196356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.196629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.196903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.202119 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 38/76] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:47.202900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.210883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.212381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.218468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 39/77] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:47.218468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.269216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.270451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.306998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c384-21fe-46a5-b929-ca4f9ac643f8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.309757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1fea6-7b55-4fb6-a375-2b4baf4316ef None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.340060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5dd09-7051-4276-a579-c0d94c7d7e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.340668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5dd09-7051-4276-a579-c0d94c7d7e58 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.340950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5dd09-7051-4276-a579-c0d94c7d7e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.341226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5dd09-7051-4276-a579-c0d94c7d7e58 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.341971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5dd09-7051-4276-a579-c0d94c7d7e58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:47.342275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5dd09-7051-4276-a579-c0d94c7d7e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.342816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.343430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.343680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5dd09-7051-4276-a579-c0d94c7d7e58 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.343776 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.343962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.344611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:47.344915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.346261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.351699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 39/78] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:47.358976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9046f34-21a1-4512-b730-5f4fb2593613 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.359113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 40/79] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:47.359216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9046f34-21a1-4512-b730-5f4fb2593613 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.359216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9046f34-21a1-4512-b730-5f4fb2593613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.359357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.373939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c9046f34-21a1-4512-b730-5f4fb2593613 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:47.375150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c9046f34-21a1-4512-b730-5f4fb2593613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:47.443583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 40/80] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:47.444945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9046f34-21a1-4512-b730-5f4fb2593613 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.461195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f028-33a2-4b28-a084-c04b4e7ebded None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.481753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.497541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.498276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.498559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.498830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.500656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.501045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.502610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.504422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 41/81] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:47.504987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.556770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9046f34-21a1-4512-b730-5f4fb2593613 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.594600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.595243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.595527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.595803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.616893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1bc6c-02fa-4aae-89d4-4cf6a5de49b1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.652927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.653564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.653846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.654120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] PATH_INFO: `/v3/users/767c0fa425fc4873b22c5fadbfb7d673` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.655730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=767c0fa425fc4873b22c5fadbfb7d673)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.657200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.658970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 42/82] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/users/767c0fa425fc4873b22c5fadbfb7d673 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:47.659578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.676497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.677958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.717961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.735346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.762697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a1355-6c5a-4f68-aa0a-eeca2cbed8e2 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.781154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 41/83] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:47.782068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.800784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.801413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.801690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.801964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.803102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.804583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.806153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 43/84] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:47.810825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:47.880605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0661-26b4-405b-b5e3-829a5ad152b7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.906963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc16e2-b238-40b8-80f1-57e555bd5b82 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:47.914549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.915173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.915458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.915738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.933538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.939076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:47.944595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:47.945193 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:47.945474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:47.945748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:47.981507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:47.983331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.011010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.012580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.086400 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 42/85] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:48.087353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.112456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 44/86] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:48.113174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.136314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.148289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.192538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165da7a0-6c31-488e-b2c9-70039a02717f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.209104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e8225-6540-45d7-a343-9f2c2111e20a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.227743 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.228376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.228658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.228934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.230054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.231581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.233097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 43/87] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:48.233930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.243867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.244501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.244787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.245063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.246200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.247691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.249318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 45/88] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:48.250149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.338276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc33ad-0b33-4c3c-95a9-7182c92b5758 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.342258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.350317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93f9ee-0956-42a3-9acf-4e8a4daa6d76 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.361269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.372506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.373108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.373386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.373663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.383466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.384355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.384983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.385557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.388161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.390057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.398634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 46/89] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:48.398634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.451840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.453300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.491566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dabb25-c170-435e-b780-d374e9031f04 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.527104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.527754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.528032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.528611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.529725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.531188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.532815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 47/90] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:48.533546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.554456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 44/91] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:48.555344 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.569299 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.578848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.639211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ef48d-e266-486d-97d9-d3101c2ef17b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.656584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b25a-628d-4fd2-9d3b-61ec17fa7ce5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.675577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.676187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.676468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.676746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.677398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.679407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.689600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.690194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.690471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.690743 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.691517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=b5b2b954da284ecb87a3f54d5505374e) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:48.691827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.693253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.699142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 45/92] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/role_assignments?user.id=b5b2b954da284ecb87a3f54d5505374e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:48.699942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.788718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 48/93] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:25:48 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:48.788718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.802693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.830368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db77f-6479-47b6-bcb0-ee9fe6ef6520 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.877537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.878174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.878459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.878738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.879599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] RBAC: Adding query filter params (role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=b5b2b954da284ecb87a3f54d5505374e) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:48.879915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.882035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.895608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 46/94] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/role_assignments?user.id=b5b2b954da284ecb87a3f54d5505374e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:48.896669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:48.914687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:48.937262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aae4a-bfd9-4a37-a62e-0dc59d5c854f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:48.984133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:48.985213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:48.985708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:48.986180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:48.987242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=767c0fa425fc4873b22c5fadbfb7d673) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:48.987761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:48.989575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:48.996844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 49/95] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/role_assignments?user.id=767c0fa425fc4873b22c5fadbfb7d673&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:49.055576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c00d6f-fc6d-4b2b-a086-8096453b5214 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:49.097053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f630b-dbb1-4bac-a96f-b9aaaaa7a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:49.098519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f630b-dbb1-4bac-a96f-b9aaaaa7a04f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:49.098995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f630b-dbb1-4bac-a96f-b9aaaaa7a04f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:49.099484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f630b-dbb1-4bac-a96f-b9aaaaa7a04f None admin] PATH_INFO: `/v3/projects/d1e62dc431f54551a1287c478ee4efd6` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:49.101047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f630b-dbb1-4bac-a96f-b9aaaaa7a04f None admin] RBAC: Authorizing `identity:get_project(project_id=d1e62dc431f54551a1287c478ee4efd6)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:49.102746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f630b-dbb1-4bac-a96f-b9aaaaa7a04f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:49.104708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 47/96] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:48 2022] GET /identity/v3/projects/d1e62dc431f54551a1287c478ee4efd6 => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:49.110807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:49.223891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0395d-1b0b-4157-bf94-e7dd8d9fe135 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:49.263557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7a7c5-24b9-4dfe-9b8c-7d1447afadf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:49.264526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a7c5-24b9-4dfe-9b8c-7d1447afadf5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:49.265002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a7c5-24b9-4dfe-9b8c-7d1447afadf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:49.265470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a7c5-24b9-4dfe-9b8c-7d1447afadf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:49.266395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7a7c5-24b9-4dfe-9b8c-7d1447afadf5 None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=d1e62dc431f54551a1287c478ee4efd6, user.id=b5b2b954da284ecb87a3f54d5505374e) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:49.266922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7a7c5-24b9-4dfe-9b8c-7d1447afadf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:49.268579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7a7c5-24b9-4dfe-9b8c-7d1447afadf5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:49.275149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 50/97] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:25:49 2022] GET /identity/v3/role_assignments?user.id=b5b2b954da284ecb87a3f54d5505374e&scope.project.id=d1e62dc431f54551a1287c478ee4efd6&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:50.877290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296a55f-9d0c-43ab-8522-8581dcdedf4d None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:50.878312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296a55f-9d0c-43ab-8522-8581dcdedf4d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:50.878792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296a55f-9d0c-43ab-8522-8581dcdedf4d None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:50.880379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 48/98] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:50.886207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778a6a-f1fd-4b0f-adf9-241512b293b6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:50.887005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778a6a-f1fd-4b0f-adf9-241512b293b6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:50.887516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778a6a-f1fd-4b0f-adf9-241512b293b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:50.911400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-30778a6a-f1fd-4b0f-adf9-241512b293b6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:50.912976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-30778a6a-f1fd-4b0f-adf9-241512b293b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:50.925284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:50.994933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 51/99] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:51.423853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2084c0-2138-4714-8091-9f6d21a6308a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:51.424222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2084c0-2138-4714-8091-9f6d21a6308a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:51.424410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2084c0-2138-4714-8091-9f6d21a6308a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:51.425964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 49/100] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:51.431745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca004-c68f-45dc-94ba-9eb38dec24a6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:51.432040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca004-c68f-45dc-94ba-9eb38dec24a6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:51.432317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca004-c68f-45dc-94ba-9eb38dec24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:51.450645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c40ca004-c68f-45dc-94ba-9eb38dec24a6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:51.451886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c40ca004-c68f-45dc-94ba-9eb38dec24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:51.538590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 52/101] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:51.558904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2084c0-2138-4714-8091-9f6d21a6308a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:51.592220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:51.688976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2084c0-2138-4714-8091-9f6d21a6308a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:51.724222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:51.724899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:51.725184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:51.725459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:51.736013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:51.741935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:51.742786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:51.743761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 50/102] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:51.748888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ca004-c68f-45dc-94ba-9eb38dec24a6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:51.856129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:51.894525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ca004-c68f-45dc-94ba-9eb38dec24a6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:51.941157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2345a7-1a7c-4e7c-bcdb-e3ef321f7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:51.942007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2345a7-1a7c-4e7c-bcdb-e3ef321f7af6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:51.942430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2345a7-1a7c-4e7c-bcdb-e3ef321f7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:51.942843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2345a7-1a7c-4e7c-bcdb-e3ef321f7af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:51.943813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2345a7-1a7c-4e7c-bcdb-e3ef321f7af6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:51.944279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2345a7-1a7c-4e7c-bcdb-e3ef321f7af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:51.945809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2345a7-1a7c-4e7c-bcdb-e3ef321f7af6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:51.958550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 53/103] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:51.964873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:51.977070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2b7a-b560-4dd2-87a0-a2c9f964c64a None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:51.977550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2b7a-b560-4dd2-87a0-a2c9f964c64a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:51.977997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2b7a-b560-4dd2-87a0-a2c9f964c64a None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:51.979505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 54/104] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:51.984570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851dee8-7d54-46af-bebd-187705f22749 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:51.984857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851dee8-7d54-46af-bebd-187705f22749 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:51.985137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851dee8-7d54-46af-bebd-187705f22749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.024188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d851dee8-7d54-46af-bebd-187705f22749 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:52.025427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d851dee8-7d54-46af-bebd-187705f22749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:52.071399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:52.091510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01886fc5-1bfa-4b8e-bea0-3ce1d9ff63e0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:52.133976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:52.134623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.134910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.135213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.136378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:52.137849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:52.139787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 51/105] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:51 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:52.140636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:52.153131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 55/106] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:52.154408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da18d0e-2a4e-4111-82c1-36cd32408363 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.154694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da18d0e-2a4e-4111-82c1-36cd32408363 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.154971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da18d0e-2a4e-4111-82c1-36cd32408363 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.156530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 56/107] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:52.157248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da18d0e-2a4e-4111-82c1-36cd32408363 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:52.231622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:52.279349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6789-a8e7-4c80-8950-eb6e82b14d0a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:52.283032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da18d0e-2a4e-4111-82c1-36cd32408363 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:52.319196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63adbe4-fd2c-44b5-bc81-e9bb90f5c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:52.319196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63adbe4-fd2c-44b5-bc81-e9bb90f5c5af None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.319196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63adbe4-fd2c-44b5-bc81-e9bb90f5c5af None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.319196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63adbe4-fd2c-44b5-bc81-e9bb90f5c5af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.322772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63adbe4-fd2c-44b5-bc81-e9bb90f5c5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-b63adbe4-fd2c-44b5-bc81-e9bb90f5c5af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:52.327814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:52.328653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:52.329425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 52/108] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:25:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:52.330166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46dcf-c396-4c6f-9e66-a71daac7f687 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.330349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46dcf-c396-4c6f-9e66-a71daac7f687 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.330643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46dcf-c396-4c6f-9e66-a71daac7f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.347492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:52.351239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ade46dcf-c396-4c6f-9e66-a71daac7f687 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:52.352513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ade46dcf-c396-4c6f-9e66-a71daac7f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:52.363862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:52.364758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.365187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.366158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.371325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:52.372983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:52.374831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 57/109] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:52 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:52.375775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:52.427515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 53/110] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:52.429240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46dcf-c396-4c6f-9e66-a71daac7f687 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:52.517722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daeb11-ee26-4492-8687-af42b8b58877 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:52.546413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:52.551166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674047c-da72-42e6-b598-8516eee6fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:52.551866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674047c-da72-42e6-b598-8516eee6fb83 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.552167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674047c-da72-42e6-b598-8516eee6fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.552410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674047c-da72-42e6-b598-8516eee6fb83 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.553608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674047c-da72-42e6-b598-8516eee6fb83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:52.553909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674047c-da72-42e6-b598-8516eee6fb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:52.555307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674047c-da72-42e6-b598-8516eee6fb83 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:52.559402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46dcf-c396-4c6f-9e66-a71daac7f687 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:52.563121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 58/111] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:25:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:52.564093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b7e8-d19f-40f5-9f34-66011c362b67 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.564374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b7e8-d19f-40f5-9f34-66011c362b67 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.564641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b7e8-d19f-40f5-9f34-66011c362b67 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.565975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 59/112] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:52.566819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63279-680f-47bf-b87f-59582a0a0a40 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.567132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63279-680f-47bf-b87f-59582a0a0a40 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.567387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f63279-680f-47bf-b87f-59582a0a0a40 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.573386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 60/113] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:52.573386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63279-680f-47bf-b87f-59582a0a0a40 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:52.606502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:52.607177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.607471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.607990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/b5b2b954da284ecb87a3f54d5505374e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.609656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e48431aba38408c99d6522a99cbbdbd, user_id=b5b2b954da284ecb87a3f54d5505374e, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:52.611084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:52.614435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:52.681950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f63279-680f-47bf-b87f-59582a0a0a40 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:52.701639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 54/114] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:25:52 2022] PUT /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/b5b2b954da284ecb87a3f54d5505374e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:25:52.709980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:52.720174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b5981-16de-4c01-9914-161ff6a70aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:52.720833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5981-16de-4c01-9914-161ff6a70aca None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.721122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5981-16de-4c01-9914-161ff6a70aca None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.721413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b5981-16de-4c01-9914-161ff6a70aca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.733806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b5981-16de-4c01-9914-161ff6a70aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-5e5b5981-16de-4c01-9914-161ff6a70aca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:52.739546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:52.741024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:52.741788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 61/115] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:52.742599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b2c57-e6f0-4a8f-bc95-ac5e315970d7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.742888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b2c57-e6f0-4a8f-bc95-ac5e315970d7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.743174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b2c57-e6f0-4a8f-bc95-ac5e315970d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.762239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-305b2c57-e6f0-4a8f-bc95-ac5e315970d7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:52.763545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-305b2c57-e6f0-4a8f-bc95-ac5e315970d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:52.816641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:52.828433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0899f-03ca-4f5a-a23d-c81108488cf8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:52.834713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 62/116] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:52.844978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eedd6-cbbb-4a1a-a944-a1534f2c1562 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.851562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eedd6-cbbb-4a1a-a944-a1534f2c1562 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.851940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eedd6-cbbb-4a1a-a944-a1534f2c1562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.868113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:52.868754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:52.869070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:52.869369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:52.871214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:52.872903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:52.874442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 55/117] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:52 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:52.875012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:52.886331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-801eedd6-cbbb-4a1a-a944-a1534f2c1562 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:52.887598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-801eedd6-cbbb-4a1a-a944-a1534f2c1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:52.958256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:52.973665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 63/118] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:52.975807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eedd6-cbbb-4a1a-a944-a1534f2c1562 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.023079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaf35c-f623-4336-ab04-adfc9aeb7a4d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.082680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.083311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.083592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.083865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.085868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eedd6-cbbb-4a1a-a944-a1534f2c1562 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.101218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:53.102207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:53.114913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:53.118728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:53.119680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 56/119] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:53.123259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.128006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.128765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.129117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.129544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.130306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:53.130680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.132199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.141078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 64/120] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:53.141834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.255695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db86e-c10e-46e4-8c7f-1ec6a225d095 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.290283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.290975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.291351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.291692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.292420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:53.292791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.294227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.303366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 65/121] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:53.304269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.332468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587127a4-a05d-4b0e-b4a6-02a8a956a49c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.349686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:53.364060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:53.378890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.379960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.380337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.380708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.384487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.386100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.392747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 57/122] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:53.392747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.415623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c50ff-f117-49cf-8807-f64fe42208a0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.449174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.449804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.450086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.450359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.451512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.453058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.454624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 66/123] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:53.456139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.505220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d77ea-5926-48b8-96cb-a71722cacbaa None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.541629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.542262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.542542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.542811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] PATH_INFO: `/v3/users/767c0fa425fc4873b22c5fadbfb7d673` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.544062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=767c0fa425fc4873b22c5fadbfb7d673)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.545497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.547128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 58/124] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/users/767c0fa425fc4873b22c5fadbfb7d673 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:53.547910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.569898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7225c-b866-49e2-a311-2780f065dd8f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.576990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:53.606750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.607630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.608067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.608663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.610446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.611960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.613001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:53.613983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 67/125] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:53.614372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.663498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c205d8-6640-4de2-a858-3382c95b9fe1 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.704393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.705086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.705370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.705646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.716701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:53.722089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:53.722953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:25:53.723739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:53.728448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 59/126] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:53.729192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.729579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ee87a-0bcd-4cf2-8791-589bcad65230 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.766019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.766691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.766973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.767281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/b5b2b954da284ecb87a3f54d5505374e/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.769467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e48431aba38408c99d6522a99cbbdbd, user_id=b5b2b954da284ecb87a3f54d5505374e, role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.770944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.833937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f953b-efb2-40ba-a017-22e42720a5e4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:53.854264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:53.868362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:53.868904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:53.869184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:53.869462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:53.870230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:53.872114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:53.879443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 68/127] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:25:53 2022] PUT /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/b5b2b954da284ecb87a3f54d5505374e/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:25:53.880492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:53.925853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:53.980258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 60/128] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:25:53 2022] POST /identity/v3/projects => generated 302 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:25:53.981514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:54.000669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1ea6-697d-4b72-ac80-5490db0d2304 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:54.044692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:54.045344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.045670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.045951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.047826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:54.049078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:54.051063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 69/129] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:54.051842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:54.112102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f768d85-a563-4b66-8125-dd1fa293979d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:54.152865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:54.153936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.154427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.154893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] PATH_INFO: `/v3/projects/d1e62dc431f54551a1287c478ee4efd6` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.156484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] RBAC: Authorizing `identity:get_project(project_id=d1e62dc431f54551a1287c478ee4efd6)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:54.158181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:54.160382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 61/130] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:53 2022] GET /identity/v3/projects/d1e62dc431f54551a1287c478ee4efd6 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:54.161373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:54.170446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d8599-3286-47a9-9d1d-99c524d59cff None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:54.172210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:54.212820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:54.213489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.213961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.214462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:54.214564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.215753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:54.216065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:54.217502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:54.228780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 70/131] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:25:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:54.234343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:54.290925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881606-26ca-4950-93ab-f4e25c4f6f1f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:54.337603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:54.338275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.338559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.338836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/767c0fa425fc4873b22c5fadbfb7d673/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.340808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e48431aba38408c99d6522a99cbbdbd, user_id=767c0fa425fc4873b22c5fadbfb7d673, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:54.342267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:54.353025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2ea4-6521-4847-9a06-ea67b76e57b5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:54.389474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:54.390145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.390610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.390777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] PATH_INFO: `/v3/projects/d1e62dc431f54551a1287c478ee4efd6/users/b5b2b954da284ecb87a3f54d5505374e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.392751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1e62dc431f54551a1287c478ee4efd6, user_id=b5b2b954da284ecb87a3f54d5505374e, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:54.394216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:54.417582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 62/132] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:25:54 2022] PUT /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/767c0fa425fc4873b22c5fadbfb7d673/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:25:54.418303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:54.472772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 71/133] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:25:54 2022] PUT /identity/v3/projects/d1e62dc431f54551a1287c478ee4efd6/users/b5b2b954da284ecb87a3f54d5505374e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:25:54.558128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:54.561601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633497a-750c-409b-ac38-3b75ed26387a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:54.607090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2254a-f2ca-45fd-b4bd-7271c612fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:54.607911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2254a-f2ca-45fd-b4bd-7271c612fefc None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.608290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2254a-f2ca-45fd-b4bd-7271c612fefc None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.608661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2254a-f2ca-45fd-b4bd-7271c612fefc None admin] PATH_INFO: `/v3/users/9156da218d5d4d30b832c6e6d75174d5` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.633684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2254a-f2ca-45fd-b4bd-7271c612fefc None admin] RBAC: Authorizing `identity:get_user(user_id=9156da218d5d4d30b832c6e6d75174d5)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:54.635354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2254a-f2ca-45fd-b4bd-7271c612fefc None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:54.637159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 63/134] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:54 2022] GET /identity/v3/users/9156da218d5d4d30b832c6e6d75174d5 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:54.643441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:54.704573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:54.795612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a009-a14d-45da-a2f5-03aa0baf9065 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:54.832607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:54.833455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.833877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.834841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.876721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3245c7c-4153-495c-95ca-474537a5d278 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.877010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3245c7c-4153-495c-95ca-474537a5d278 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.877289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3245c7c-4153-495c-95ca-474537a5d278 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.878796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 64/135] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:54.884502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0211de-cfc6-4acc-bc78-ec09c96af629 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.884788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0211de-cfc6-4acc-bc78-ec09c96af629 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.885067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0211de-cfc6-4acc-bc78-ec09c96af629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.917621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:54.919139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:54.927305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8b0211de-cfc6-4acc-bc78-ec09c96af629 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:54.928542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8b0211de-cfc6-4acc-bc78-ec09c96af629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:54.963830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:55.029733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 72/136] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:55.035737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:55.129948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 65/137] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:55.138764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1079e-3b59-485b-b16a-fd4b98f0b2f2 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:55.171565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:55.174941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:55.175661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:55.176134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:55.176498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:55.178518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:55.180138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:55.182084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 73/138] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:55 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:25:55.188137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0211de-cfc6-4acc-bc78-ec09c96af629 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:55.301371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:55.314651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0211de-cfc6-4acc-bc78-ec09c96af629 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:55.361753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:55.362374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:55.362658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:55.362932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:55.363718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] RBAC: Adding query filter params (role.id=5bedb2008a21424db91cb7ec7aff4abc, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=9156da218d5d4d30b832c6e6d75174d5) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:55.364028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:55.365576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:55.375561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 66/139] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:25:55 2022] GET /identity/v3/role_assignments?user.id=9156da218d5d4d30b832c6e6d75174d5&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=5bedb2008a21424db91cb7ec7aff4abc => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:55.673468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:55.793418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08d9e7-080c-4d5f-910f-ab5e79014610 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:55.828679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:55.829672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:55.830168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:55.830632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:55.841491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:55.846496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:55.847358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:55.848134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:55.851220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 74/140] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:55.860287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:55.998162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d6e5-f28b-46be-9ce5-60d803b03712 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:56.047646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:56.048263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.048548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.048822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.049492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] RBAC: Adding query filter params (name=member) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:56.049797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:56.051189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:56.062535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 67/141] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:56.068812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:56.148339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:56.201279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b3ddb-d2f6-4fe1-a166-fc21ca297cd3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:56.241114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:56.241756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.242036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.242313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.243696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:56.245163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:56.246766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 75/142] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:56 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:56.252556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:56.274646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:56.386583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886fe42-0665-4ae3-ad01-dd53d18ea17f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:56.437220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bf874-1071-45f4-82e0-2afb841358ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:56.437845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bf874-1071-45f4-82e0-2afb841358ae None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.438131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bf874-1071-45f4-82e0-2afb841358ae None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.438408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bf874-1071-45f4-82e0-2afb841358ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.525506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bf874-1071-45f4-82e0-2afb841358ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:56.527020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bf874-1071-45f4-82e0-2afb841358ae None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:56.550139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:56.656049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 68/143] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:56.661157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:56.746499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7146-083d-4604-8e73-a053f76c9ae7 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.746787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7146-083d-4604-8e73-a053f76c9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.747065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7146-083d-4604-8e73-a053f76c9ae7 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.748573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 69/144] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:25:56.753912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7488d5-7f01-44d0-9d41-f89e608ac43f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.754207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7488d5-7f01-44d0-9d41-f89e608ac43f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.754487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7488d5-7f01-44d0-9d41-f89e608ac43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.788351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9c7488d5-7f01-44d0-9d41-f89e608ac43f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:56.791210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9c7488d5-7f01-44d0-9d41-f89e608ac43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:56.820298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a2450-7964-465a-a2b8-1da62b0d264c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:56.855554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:56.869023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58a9d-2b40-4d18-8d7d-aa8bc4fca42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:56.869927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58a9d-2b40-4d18-8d7d-aa8bc4fca42b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.870421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58a9d-2b40-4d18-8d7d-aa8bc4fca42b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.870904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58a9d-2b40-4d18-8d7d-aa8bc4fca42b None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.872328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58a9d-2b40-4d18-8d7d-aa8bc4fca42b None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:56.874881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58a9d-2b40-4d18-8d7d-aa8bc4fca42b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:56.877229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 76/145] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:56 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:56.879371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea1bc-1f4e-4dab-97a3-ba33563a31ef None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.883866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea1bc-1f4e-4dab-97a3-ba33563a31ef None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.884307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea1bc-1f4e-4dab-97a3-ba33563a31ef None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.886168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 77/146] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:56.887775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea1bc-1f4e-4dab-97a3-ba33563a31ef None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:56.931203 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 70/147] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:25:56.933866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd509-fbf7-4d66-b583-943967b8ddde None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:56.934281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd509-fbf7-4d66-b583-943967b8ddde None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:56.939511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd509-fbf7-4d66-b583-943967b8ddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:56.979677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-414cd509-fbf7-4d66-b583-943967b8ddde None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:56.980890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-414cd509-fbf7-4d66-b583-943967b8ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:57.028092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eea1bc-1f4e-4dab-97a3-ba33563a31ef None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:57.067237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:57.102509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:57.103187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.103502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.103833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.104575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=b5b2b954da284ecb87a3f54d5505374e) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:57.104890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:57.106373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:57.116992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 71/148] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:57.137222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 78/149] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:25:56 2022] GET /identity/v3/role_assignments?user.id=b5b2b954da284ecb87a3f54d5505374e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:57.441819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd509-fbf7-4d66-b583-943967b8ddde None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:57.453471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:57.519500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:57.580190 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec220644-b58c-4de7-b4b7-af70388b216f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:57.619000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:57.619671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.619948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.620218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.622126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd509-fbf7-4d66-b583-943967b8ddde None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:57.645502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:57.652582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:57.653649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:25:57.654564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:25:57.661654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 79/150] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:25:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:25:57.662759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:57.673329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2d9a6-8968-4360-8bac-6a907dbeedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:57.673997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2d9a6-8968-4360-8bac-6a907dbeedf7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.674290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2d9a6-8968-4360-8bac-6a907dbeedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.674567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2d9a6-8968-4360-8bac-6a907dbeedf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.676277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2d9a6-8968-4360-8bac-6a907dbeedf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:57.678676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2d9a6-8968-4360-8bac-6a907dbeedf7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:57.681396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 72/151] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:57.682870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8537cb-4cb4-4571-834a-6bb2af7ee4e7 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.683215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8537cb-4cb4-4571-834a-6bb2af7ee4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.683453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8537cb-4cb4-4571-834a-6bb2af7ee4e7 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.688909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 73/152] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:57.688909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717861e-4724-4003-9490-8f5b373b294a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.688909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717861e-4724-4003-9490-8f5b373b294a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.688909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717861e-4724-4003-9490-8f5b373b294a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.689225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 74/153] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:57.689978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717861e-4724-4003-9490-8f5b373b294a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:57.751409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:57.799753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557edd-6970-4939-8df3-972c178e5e16 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:57.812508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717861e-4724-4003-9490-8f5b373b294a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:57.815524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:57.838211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c011-73a1-495d-9c3c-b4155efd9ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:57.838865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c011-73a1-495d-9c3c-b4155efd9ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.839184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c011-73a1-495d-9c3c-b4155efd9ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.839675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c011-73a1-495d-9c3c-b4155efd9ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.840500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c011-73a1-495d-9c3c-b4155efd9ed4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:57.841257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c011-73a1-495d-9c3c-b4155efd9ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:57.842824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c011-73a1-495d-9c3c-b4155efd9ed4 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:57.851657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 80/154] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:25:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:57.852108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:57.852881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.853284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.853699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b877a-97bb-4189-88e8-c516fefb8ae7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.853806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.854115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b877a-97bb-4189-88e8-c516fefb8ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.854390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b877a-97bb-4189-88e8-c516fefb8ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.854860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:57.856465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:57.874008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9a7b877a-97bb-4189-88e8-c516fefb8ae7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:57.875696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9a7b877a-97bb-4189-88e8-c516fefb8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:57.942964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 81/155] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:57.944977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e04e-cb86-442f-98d5-78831c506979 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:57.945262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e04e-cb86-442f-98d5-78831c506979 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:57.945522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81e04e-cb86-442f-98d5-78831c506979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:57.960005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 75/156] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:25:57 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:25:57.961035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:57.967303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-af81e04e-cb86-442f-98d5-78831c506979 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:57.969061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-af81e04e-cb86-442f-98d5-78831c506979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:58.072669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 82/157] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:58.132375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.136341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b9cf-8dc0-4c56-94a4-023783e95d2b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.172488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:58.173132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.173415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.173689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.174832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:58.176456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:58.178749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 76/158] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:57 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:58.184476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81e04e-cb86-442f-98d5-78831c506979 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:58.220500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.252417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:58.297403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81e04e-cb86-442f-98d5-78831c506979 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.348356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:58.349200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.349559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.349840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.393278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901bcf6-62f1-41d8-82c4-7c62a76c2d25 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.433561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:58.435722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:58.440637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee4eb-3f6f-4be8-850b-27a70bdb9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:58.441453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee4eb-3f6f-4be8-850b-27a70bdb9224 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.441897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee4eb-3f6f-4be8-850b-27a70bdb9224 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.442726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee4eb-3f6f-4be8-850b-27a70bdb9224 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.457244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ee4eb-3f6f-4be8-850b-27a70bdb9224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6e8ee4eb-3f6f-4be8-850b-27a70bdb9224 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:58.463815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:58.464756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:25:58.465677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:58.467014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 77/159] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:25:58.468316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779fab-81ff-4d86-bc7a-3be0a3c082b8 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.468600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779fab-81ff-4d86-bc7a-3be0a3c082b8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.468870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779fab-81ff-4d86-bc7a-3be0a3c082b8 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.470242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 78/160] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:58.471301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d779fab-81ff-4d86-bc7a-3be0a3c082b8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:58.482831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.504607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.562231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 83/161] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:58.567060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:58.608827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d779fab-81ff-4d86-bc7a-3be0a3c082b8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.667351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee7e64-8269-4641-9097-c1cb4d1f910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:58.668543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee7e64-8269-4641-9097-c1cb4d1f910a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.668966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee7e64-8269-4641-9097-c1cb4d1f910a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.669628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee7e64-8269-4641-9097-c1cb4d1f910a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.684441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee7e64-8269-4641-9097-c1cb4d1f910a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-36ee7e64-8269-4641-9097-c1cb4d1f910a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:25:58.691036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:25:58.692100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:25:58.692847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:25:58.695322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 79/162] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:25:58.696980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8fff2-bcd5-4e46-97d5-f3c2c0ef3b9d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.697255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8fff2-bcd5-4e46-97d5-f3c2c0ef3b9d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.697519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8fff2-bcd5-4e46-97d5-f3c2c0ef3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.698229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85482-ee42-42b1-b512-2b5dc9f9fa88 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.721084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-86d8fff2-bcd5-4e46-97d5-f3c2c0ef3b9d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:58.722712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-86d8fff2-bcd5-4e46-97d5-f3c2c0ef3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:58.743838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:58.745168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.745620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.746033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.746738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:58.748037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:58.748935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:58.750432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.761358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 84/163] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:58.762539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:58.808011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 80/164] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:25:58.808724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8fff2-bcd5-4e46-97d5-f3c2c0ef3b9d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:58.850530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.926067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8fff2-bcd5-4e46-97d5-f3c2c0ef3b9d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.941276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7ada-4399-4b13-a5d4-91469cf186b5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.962323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:58.963060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.963364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.963638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.964312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:58.964616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:58.966011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:58.975738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 81/165] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:58.976542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:59.023865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:59.024508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:59.024791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:59.025054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:59.026212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:59.027678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:59.029504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 85/166] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:59.030052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:59.067659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:59.085592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218a4d7-aad6-4f35-a963-98da0c6796f1 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:59.097198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:59.123580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:59.124219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:59.124501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:59.124775 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] PATH_INFO: `/v3/users/b5b2b954da284ecb87a3f54d5505374e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:59.125944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] RBAC: Authorizing `identity:get_user(user_id=b5b2b954da284ecb87a3f54d5505374e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:59.127430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:59.129219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 82/167] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/users/b5b2b954da284ecb87a3f54d5505374e => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:59.129997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:59.140082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60890-ddd4-408c-8a47-b4e0b7856f56 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:59.177002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:59.177606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:59.177879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:59.178147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] PATH_INFO: `/v3/users/767c0fa425fc4873b22c5fadbfb7d673` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:59.179304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] RBAC: Authorizing `identity:get_user(user_id=767c0fa425fc4873b22c5fadbfb7d673)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:59.180760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:59.182536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 86/168] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:25:59 2022] GET /identity/v3/users/767c0fa425fc4873b22c5fadbfb7d673 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:59.183089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:59.276019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9727-29b6-4308-b547-7616617aa8ba None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:59.321269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:59.321875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:59.322145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:59.322408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:59.326549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] RBAC: Adding query filter params (role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=b5b2b954da284ecb87a3f54d5505374e) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:25:59.326549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:59.326549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:59.331292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 83/169] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:25:59 2022] GET /identity/v3/role_assignments?user.id=b5b2b954da284ecb87a3f54d5505374e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:25:59.332084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:59.337708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf5855-7a00-416b-9deb-254f028533a0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:59.347599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:59.425559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:59.434790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:59.435487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:59.435824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:59.436166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:59.524044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7f098-fcd7-45f0-ab20-797023f61d31 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:59.593226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:59.594821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:59.616819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:59.617448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:59.617729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:59.617996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:59.716634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:59.718545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:59.737592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:59.815936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 87/170] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:59.816791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:59.851254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 84/171] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:59.852448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:59.897170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:59.966052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bec149-ace2-4eb4-aa3b-1671622486ae None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:59.995749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:00.008371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:00.009009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.009281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.009546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] PATH_INFO: `/v3/projects/d1e62dc431f54551a1287c478ee4efd6` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.012672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] RBAC: Authorizing `identity:get_project(project_id=d1e62dc431f54551a1287c478ee4efd6)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:00.014131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:00.016007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 85/172] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:25:59 2022] GET /identity/v3/projects/d1e62dc431f54551a1287c478ee4efd6 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:00.016548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:00.109357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d4a9-a1b4-4a4d-8f22-17866038b51d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:00.163937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb44ac-7a55-4a19-a84d-882e8f40c22a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:00.164879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:00.165908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.166377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.166835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.179765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:00.184870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:00.185714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:00.186676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:00.189666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 88/173] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:25:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:00.190692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:00.257536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:00.258104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.258386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.258668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.259841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:00.261352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:00.268462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 86/174] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:00 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:00.269430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:00.303892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:00.313850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a77934-6c5c-442a-a12c-1168a652752e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:00.354860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:00.355901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.356191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.356474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.357211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=d1e62dc431f54551a1287c478ee4efd6, user.id=b5b2b954da284ecb87a3f54d5505374e) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:00.357526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:00.358988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:00.369293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 89/175] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:00 2022] GET /identity/v3/role_assignments?user.id=b5b2b954da284ecb87a3f54d5505374e&scope.project.id=d1e62dc431f54551a1287c478ee4efd6&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:00.370192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:00.392248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:00.493065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441f4b8-4399-4e12-a875-4ee7b9c40649 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:00.534879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:00.535534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.535812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.536086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.537357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=767c0fa425fc4873b22c5fadbfb7d673) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:00.537667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:00.539123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:00.542113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc2de-d120-425d-ae9b-cc8640468fee None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:00.546483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 90/176] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:00 2022] GET /identity/v3/role_assignments?user.id=767c0fa425fc4873b22c5fadbfb7d673&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:00.606947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:00.607613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.607895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.608170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.608855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:00.609162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:00.610547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:00.620685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 87/177] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:00.626586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:00.681086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:00.776879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96f602-7dd7-48f2-b536-ac98592b4574 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:00.813678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9afe8-d13c-4b1f-9c14-74f1b9447399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:00.814299 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9afe8-d13c-4b1f-9c14-74f1b9447399 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.814579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9afe8-d13c-4b1f-9c14-74f1b9447399 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.814858 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9afe8-d13c-4b1f-9c14-74f1b9447399 None admin] PATH_INFO: `/v3/users/9156da218d5d4d30b832c6e6d75174d5` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.816072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9afe8-d13c-4b1f-9c14-74f1b9447399 None admin] RBAC: Authorizing `identity:get_user(user_id=9156da218d5d4d30b832c6e6d75174d5)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:00.817532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9afe8-d13c-4b1f-9c14-74f1b9447399 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:00.820217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 91/178] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:00 2022] GET /identity/v3/users/9156da218d5d4d30b832c6e6d75174d5 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:00.825856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:00.834065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572ad6-8a24-45e5-ad24-ce303af5d2bf None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.834380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572ad6-8a24-45e5-ad24-ce303af5d2bf None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.834545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572ad6-8a24-45e5-ad24-ce303af5d2bf None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.835953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 92/179] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:00.841686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e2f9-f23c-443e-8f9b-a71fce565ebb None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:00.841973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e2f9-f23c-443e-8f9b-a71fce565ebb None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:00.842250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e2f9-f23c-443e-8f9b-a71fce565ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:00.867315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-98a1e2f9-f23c-443e-8f9b-a71fce565ebb None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:00.868653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-98a1e2f9-f23c-443e-8f9b-a71fce565ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:00.948890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 93/180] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:00.963464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5588b3f-8f03-4dce-821c-fc2537935a3e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:00.972971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.001450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ad223-092e-4564-969d-57587f79ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.002144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ad223-092e-4564-969d-57587f79ed04 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.002424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ad223-092e-4564-969d-57587f79ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.002692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ad223-092e-4564-969d-57587f79ed04 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.003884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ad223-092e-4564-969d-57587f79ed04 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:01.005440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ad223-092e-4564-969d-57587f79ed04 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:01.007561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 88/181] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:00 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:01.013216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e2f9-f23c-443e-8f9b-a71fce565ebb None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.039543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.145192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e2f9-f23c-443e-8f9b-a71fce565ebb None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:01.160565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800d28e-f442-42dc-8484-b9bc42bcca55 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.160882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800d28e-f442-42dc-8484-b9bc42bcca55 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.161686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800d28e-f442-42dc-8484-b9bc42bcca55 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.162660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 89/182] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:01.168451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ae92-5144-4d19-b6a6-46fe98a160dd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.168732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ae92-5144-4d19-b6a6-46fe98a160dd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.169241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6ae92-5144-4d19-b6a6-46fe98a160dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.189214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-99d6ae92-5144-4d19-b6a6-46fe98a160dd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:01.209800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792c131-afd4-47b9-a7b7-fcd30109f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.209955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-99d6ae92-5144-4d19-b6a6-46fe98a160dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:01.210040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c131-afd4-47b9-a7b7-fcd30109f455 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.210040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c131-afd4-47b9-a7b7-fcd30109f455 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.210040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c131-afd4-47b9-a7b7-fcd30109f455 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/9156da218d5d4d30b832c6e6d75174d5/roles/5bedb2008a21424db91cb7ec7aff4abc` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.210040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792c131-afd4-47b9-a7b7-fcd30109f455 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e48431aba38408c99d6522a99cbbdbd, user_id=9156da218d5d4d30b832c6e6d75174d5, role_id=5bedb2008a21424db91cb7ec7aff4abc)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:01.210040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792c131-afd4-47b9-a7b7-fcd30109f455 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:01.262549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 90/183] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:01.270691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6ae92-5144-4d19-b6a6-46fe98a160dd None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.338910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 94/184] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:01 2022] PUT /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd/users/9156da218d5d4d30b832c6e6d75174d5/roles/5bedb2008a21424db91cb7ec7aff4abc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:01.346972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172cfab-f8e2-4253-83b2-4ed79692169a None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.346972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172cfab-f8e2-4253-83b2-4ed79692169a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.346972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172cfab-f8e2-4253-83b2-4ed79692169a None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.346972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 95/185] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:01.348581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cbdc6-29e5-4771-813d-7dd7f0632ee4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.348865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cbdc6-29e5-4771-813d-7dd7f0632ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.349138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cbdc6-29e5-4771-813d-7dd7f0632ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.374628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-236cbdc6-29e5-4771-813d-7dd7f0632ee4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:01.376218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-236cbdc6-29e5-4771-813d-7dd7f0632ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:01.386752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6ae92-5144-4d19-b6a6-46fe98a160dd None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:01.396159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.427138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.428340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.428613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.428881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.440465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:01.446265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:01.447272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:01.448348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 91/186] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:01.453260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.472249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 96/187] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:01.544642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cbdc6-29e5-4771-813d-7dd7f0632ee4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.556705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.572791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23ad6-a05a-4b97-b66c-e37bbaac0b2d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:01.620471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.621508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.622113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.622568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.624006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:01.624508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:01.626052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:01.637146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 92/188] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:01.643193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.669573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cbdc6-29e5-4771-813d-7dd7f0632ee4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:01.683012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.707538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.708173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.708456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.708757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.709881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:01.711366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:01.713263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 97/189] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:01.719371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.762812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4dc83-8673-4f8d-8690-a806208caca6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:01.799431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.800160 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.800437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.800701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] PATH_INFO: `/v3/users/6e6ed487189d4e51a453825395924fe8` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.815016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=6e6ed487189d4e51a453825395924fe8)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:01.815479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.816637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:01.818509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 93/190] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:01 2022] GET /identity/v3/users/6e6ed487189d4e51a453825395924fe8 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:01.819097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.843467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145b89-199e-4030-b4db-fb77c4f70855 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:01.879230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.880004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.880132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.880354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.881574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:01.882964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:01.919220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.933688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b56dc3-1cde-4e32-bb42-2ab3378d3ad4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:01.965978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 98/191] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:01 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:01.966815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:01.979185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:01.979185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.979681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.979681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.003257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:02.011725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:02.012679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:02.013460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 94/192] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:02.019464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:02.100300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff857-0a33-4b89-bbd8-821c212bba1b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:02.137802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:02.150470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:02.151086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:02.151422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:02.151689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.161624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73816a-ce31-4eb6-a459-e8297e1016c7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:02.201103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:02.203995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:02.203995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:02.203995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.203995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:02.203995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:02.206181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:02.215478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 95/193] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:02.220865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:02.237474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:02.252374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:02.253045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:02.363427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158cce-5783-4209-ab28-1c57cf55d0bc None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:02.394503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 99/194] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:02.399912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:02.420476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:02.421166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:02.421374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:02.421641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] PATH_INFO: `/v3/users/6e6ed487189d4e51a453825395924fe8` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.422784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] RBAC: Authorizing `identity:get_user(user_id=6e6ed487189d4e51a453825395924fe8)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:02.424503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:02.426377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 96/195] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:02 2022] GET /identity/v3/users/6e6ed487189d4e51a453825395924fe8 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:02.433740 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:02.439550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:02.515890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:02.540596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46757502-6614-4513-96e9-7031e8f37e7d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:02.558400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457aaea-7cbe-4d8c-ac7b-d28dd7aee190 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:02.577628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:02.578238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:02.578516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:02.583225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.657419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:02.658407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:02.658938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:02.659394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.661039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:02.663241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:02.666068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 100/196] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:02 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:02.672249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:02.703537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:02.706437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:02.835606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:02.840207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b5d1d-9d2e-468f-97b5-bcc9364ccb10 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:02.841806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:02.874209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 97/197] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:02.875819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:02.876521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:02.876911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:02.877278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.878096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=6e6ed487189d4e51a453825395924fe8) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:02.878499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:02.879753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:02.880151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:02.887356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 101/198] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:02 2022] GET /identity/v3/role_assignments?user.id=6e6ed487189d4e51a453825395924fe8&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:03.027399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fc56-bbb7-49f2-bdfb-b5df51830372 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:03.082318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a5850-ec20-4b16-b7d7-e6ff772ca635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:03.083252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5850-ec20-4b16-b7d7-e6ff772ca635 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:03.083730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5850-ec20-4b16-b7d7-e6ff772ca635 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:03.084140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5850-ec20-4b16-b7d7-e6ff772ca635 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:03.087958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a5850-ec20-4b16-b7d7-e6ff772ca635 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:03.089643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a5850-ec20-4b16-b7d7-e6ff772ca635 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:03.091893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 98/199] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:02 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:03.097425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:03.237970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91312a1-5c67-4d1e-87b8-9fc190278239 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:03.281158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770833ff-d8f7-41a6-b639-01aafe12b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:03.281766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770833ff-d8f7-41a6-b639-01aafe12b0ed None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:03.282040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770833ff-d8f7-41a6-b639-01aafe12b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:03.282362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770833ff-d8f7-41a6-b639-01aafe12b0ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:03.283089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770833ff-d8f7-41a6-b639-01aafe12b0ed None admin] RBAC: Adding query filter params (role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=6e6ed487189d4e51a453825395924fe8) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:03.283450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770833ff-d8f7-41a6-b639-01aafe12b0ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:03.284952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770833ff-d8f7-41a6-b639-01aafe12b0ed None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:03.291139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 102/200] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:03 2022] GET /identity/v3/role_assignments?user.id=6e6ed487189d4e51a453825395924fe8&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:03.590759 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48475d8-78b4-4dee-bfd1-f05188996d06 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:03.591736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48475d8-78b4-4dee-bfd1-f05188996d06 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:03.592231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48475d8-78b4-4dee-bfd1-f05188996d06 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:03.594010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 99/201] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:03.599970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd64a-9525-4176-b014-fd650a37e9f7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:03.600773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd64a-9525-4176-b014-fd650a37e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:03.601238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd64a-9525-4176-b014-fd650a37e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:03.620267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-51ddd64a-9525-4176-b014-fd650a37e9f7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:03.621791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-51ddd64a-9525-4176-b014-fd650a37e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:03.646844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:03.711940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 103/202] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:04.069161 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48475d8-78b4-4dee-bfd1-f05188996d06 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:04.129505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:04.193156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48475d8-78b4-4dee-bfd1-f05188996d06 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:04.238586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:04.239257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.239544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.239817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.255772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:04.260908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:04.261753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:04.262628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:04.264587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 100/203] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:04.270341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddd64a-9525-4176-b014-fd650a37e9f7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:04.403983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddd64a-9525-4176-b014-fd650a37e9f7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:04.447573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfc588-b9cf-45d2-b909-74b232938c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:04.448412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc588-b9cf-45d2-b909-74b232938c69 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.448827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc588-b9cf-45d2-b909-74b232938c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.449249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc588-b9cf-45d2-b909-74b232938c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.450058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfc588-b9cf-45d2-b909-74b232938c69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:04.450493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfc588-b9cf-45d2-b909-74b232938c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:04.452023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfc588-b9cf-45d2-b909-74b232938c69 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:04.465533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 104/204] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:04.466711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:04.507105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b44b-40a8-4462-9f1c-e8d58b1693d8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.507467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b44b-40a8-4462-9f1c-e8d58b1693d8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.507679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b44b-40a8-4462-9f1c-e8d58b1693d8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.509139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 105/205] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:04.514010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef623c25-4034-4bcc-bcbc-119115ae5c0b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.514286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef623c25-4034-4bcc-bcbc-119115ae5c0b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.514556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef623c25-4034-4bcc-bcbc-119115ae5c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.532969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ef623c25-4034-4bcc-bcbc-119115ae5c0b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:04.534158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ef623c25-4034-4bcc-bcbc-119115ae5c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:04.549156 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:04.610281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 106/206] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:04.615279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965112-862c-47be-b842-11269abd4205 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.615279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965112-862c-47be-b842-11269abd4205 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.615279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965112-862c-47be-b842-11269abd4205 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.615279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 107/207] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:04.618561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c92197-c568-4096-b559-249c700e38c4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.618836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c92197-c568-4096-b559-249c700e38c4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.619105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c92197-c568-4096-b559-249c700e38c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.622774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ac295-77a5-4641-a4be-527069c4b02f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:04.629037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:04.638960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b5c92197-c568-4096-b559-249c700e38c4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:04.640611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b5c92197-c568-4096-b559-249c700e38c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:04.698746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:04.700235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.700874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.701907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] PATH_INFO: `/v3/users/9156da218d5d4d30b832c6e6d75174d5` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.704208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] RBAC: Authorizing `identity:get_user(user_id=9156da218d5d4d30b832c6e6d75174d5)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:04.708032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:04.710664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 101/208] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:04 2022] GET /identity/v3/users/9156da218d5d4d30b832c6e6d75174d5 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:04.716093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:04.754860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 108/209] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:04.829973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbca619-e0bd-4816-9634-cc2d637ac111 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:04.869729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:04.870339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.870612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.870876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.929913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:04.966578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:04.968072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.030172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c92197-c568-4096-b559-249c700e38c4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.113950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.125134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 102/210] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:26:05.125975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.135719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c92197-c568-4096-b559-249c700e38c4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.178456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.179268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.179545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.180217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.181368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:05.182850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.184782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 109/211] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:05.185556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.221756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.244176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606216e6-48b1-4c36-b2b8-1bf07d72cdc2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.285291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.285981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.286255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.286568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.297183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:05.302079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:05.303548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 103/212] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:05.305007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.336383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87a760-555d-488e-ae49-e232e6a16dee None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.375318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8fcbe-108d-4ef5-9ed1-ce713ed6b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.375937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8fcbe-108d-4ef5-9ed1-ce713ed6b553 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.376211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8fcbe-108d-4ef5-9ed1-ce713ed6b553 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.376479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8fcbe-108d-4ef5-9ed1-ce713ed6b553 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.377679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8fcbe-108d-4ef5-9ed1-ce713ed6b553 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:05.379140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8fcbe-108d-4ef5-9ed1-ce713ed6b553 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.386273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 110/213] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:05.386273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225461-02f9-459c-8fc6-d0398a453a27 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.386273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225461-02f9-459c-8fc6-d0398a453a27 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.386273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225461-02f9-459c-8fc6-d0398a453a27 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.386273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 111/214] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:05.386273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96225461-02f9-459c-8fc6-d0398a453a27 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.407841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.423032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ec27-fb3f-401c-ba90-3dec12ff640d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.458689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.463451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.464046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.464321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.464589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.465241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:05.466698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.498273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96225461-02f9-459c-8fc6-d0398a453a27 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.532764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d21159-1653-4f5c-9b89-1fcd6a1d1ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.533424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21159-1653-4f5c-9b89-1fcd6a1d1ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.533726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21159-1653-4f5c-9b89-1fcd6a1d1ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.533995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21159-1653-4f5c-9b89-1fcd6a1d1ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.534657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d21159-1653-4f5c-9b89-1fcd6a1d1ac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:05.534958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d21159-1653-4f5c-9b89-1fcd6a1d1ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:05.536401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d21159-1653-4f5c-9b89-1fcd6a1d1ac1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.543524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 104/215] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:05 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:05.544327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.557364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 112/216] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:05.558634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb1b64-55f1-4059-bffb-de7b2b3b1852 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.558920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb1b64-55f1-4059-bffb-de7b2b3b1852 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.567341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb1b64-55f1-4059-bffb-de7b2b3b1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.591583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c3eb1b64-55f1-4059-bffb-de7b2b3b1852 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:05.593601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c3eb1b64-55f1-4059-bffb-de7b2b3b1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:05.689835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949af46-8680-41d8-bbd7-7b777a05d6c7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.695950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 113/217] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:05.696799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb1b64-55f1-4059-bffb-de7b2b3b1852 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.710194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.732649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbccc-f4b7-413b-9f8f-a94a711ed7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.733572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbccc-f4b7-413b-9f8f-a94a711ed7ea None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.734027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbccc-f4b7-413b-9f8f-a94a711ed7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.734505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbccc-f4b7-413b-9f8f-a94a711ed7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.735545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bbccc-f4b7-413b-9f8f-a94a711ed7ea None admin] RBAC: Adding query filter params (role.id=5bedb2008a21424db91cb7ec7aff4abc, scope.project.id=7e48431aba38408c99d6522a99cbbdbd, user.id=9156da218d5d4d30b832c6e6d75174d5) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:05.736155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bbccc-f4b7-413b-9f8f-a94a711ed7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:05.738118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bbccc-f4b7-413b-9f8f-a94a711ed7ea None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.747367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 105/218] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/role_assignments?user.id=9156da218d5d4d30b832c6e6d75174d5&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=5bedb2008a21424db91cb7ec7aff4abc => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:05.819703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb1b64-55f1-4059-bffb-de7b2b3b1852 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.836142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5192ae-76b1-4834-b962-9e5a12d622ad None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.836442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5192ae-76b1-4834-b962-9e5a12d622ad None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.836691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5192ae-76b1-4834-b962-9e5a12d622ad None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.838268 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 106/219] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:05.844869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda0e7-5883-47ed-8d41-7f09fd7be51a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.845174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda0e7-5883-47ed-8d41-7f09fd7be51a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.845431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda0e7-5883-47ed-8d41-7f09fd7be51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.869990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.870218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1bdda0e7-5883-47ed-8d41-7f09fd7be51a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:05.870651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.870928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.871247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] PATH_INFO: `/v3/users/59327b450b514573a4644d20dd48d74c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.871422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1bdda0e7-5883-47ed-8d41-7f09fd7be51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:05.895669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] RBAC: Authorizing `identity:get_user(user_id=59327b450b514573a4644d20dd48d74c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:05.898697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.901334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 114/220] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/users/59327b450b514573a4644d20dd48d74c => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:05.910155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.945433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.967194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 107/221] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:05.997663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:06.006436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda0e7-5883-47ed-8d41-7f09fd7be51a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.045488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe6029-3cc4-474e-b275-4d4d0244df75 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.091482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.091837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.092103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.092378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.139776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda0e7-5883-47ed-8d41-7f09fd7be51a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.178027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:06.179558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:06.193530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.194519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.195018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.195507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.211485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:06.218551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:06.219445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:06.220243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:06.223578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 108/222] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:06.229427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.259544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:06.288368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:06.301849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 115/223] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:06.303435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.353107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b079e-6a08-4823-8a7a-0f89d58e0e1a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.396215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.398138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.398531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.398903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.399719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:06.400127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:06.401608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:06.414210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 109/224] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:06.415551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.432016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12630178-5948-4caf-b2bc-dfc94aa4bbbc None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.469136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.469996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.470437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.470920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.482987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:06.488195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:06.489083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:06.490061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:06.492369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 116/225] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:06.493486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.523623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:06.549494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844a9eb-0aa2-4af1-b48f-ac821ddf4120 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.551896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:06.585876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.586521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.586803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.587078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.588389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:06.589821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:06.591497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 110/226] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:06.592261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.605677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71d2e0-7c86-4dd8-b40f-70148a9631fb None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.653389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.654289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.654774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.655309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] PATH_INFO: `/v3/users/6e6ed487189d4e51a453825395924fe8` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.656765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] RBAC: Authorizing `identity:get_user(user_id=6e6ed487189d4e51a453825395924fe8)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:06.658509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:06.660879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 117/227] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/users/6e6ed487189d4e51a453825395924fe8 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:06.662084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.700773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fb58-1e69-49dc-ac6b-295871d72c9a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.735466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.736036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.736274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.736547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.737207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:06.737512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:06.738928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:06.747905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 111/228] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:06.748733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.770355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:06.778873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ad4e3-6d16-475a-854e-c5d5c3076e84 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.785422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:06.814674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.815716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.816337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.816821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.817774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=59327b450b514573a4644d20dd48d74c) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:06.818830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:06.820653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:06.827079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 118/229] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/role_assignments?user.id=59327b450b514573a4644d20dd48d74c&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:06.828224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.854657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10d99e-3090-437d-95bb-ba56b787ff65 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.903951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.904652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.904931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.905203 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.906507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:06.908971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:06.910112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 112/230] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:06.916723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:06.945595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8157eb-4337-44c9-8f20-e8c594f6ff0c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:06.994471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:06.995552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:06.996034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:06.996563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] PATH_INFO: `/v3/users/6e6ed487189d4e51a453825395924fe8` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:06.998212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=6e6ed487189d4e51a453825395924fe8)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:07.000925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:07.006323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 119/231] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:06 2022] GET /identity/v3/users/6e6ed487189d4e51a453825395924fe8 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:07.010343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:07.073812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:07.125111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a23e29-82fa-48fa-94d8-e3f06f5465f9 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:07.129057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:07.195860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d68435-695e-49a8-a39b-b77bb267a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:07.196984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d68435-695e-49a8-a39b-b77bb267a52d None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:07.197868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d68435-695e-49a8-a39b-b77bb267a52d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:07.198482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d68435-695e-49a8-a39b-b77bb267a52d None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c/users/6e6ed487189d4e51a453825395924fe8/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:07.202771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d68435-695e-49a8-a39b-b77bb267a52d None admin] RBAC: Authorizing `identity:create_grant(project_id=48a104c3059e41fb968cc1394871836c, user_id=6e6ed487189d4e51a453825395924fe8, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:07.206186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d68435-695e-49a8-a39b-b77bb267a52d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:07.217748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4316-553e-455d-9fbe-6d4cb390a2a6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:07.254291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:07.255920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:07.256403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:07.256871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:07.258351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:07.260088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:07.261945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 120/232] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:07 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:07.267935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:07.370202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:07.377302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceb5ad-4b08-4b65-a528-242300591977 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:07.413480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ae1fa-7693-4a28-afcf-502e0b7066bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:07.414147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae1fa-7693-4a28-afcf-502e0b7066bb None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:07.414425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae1fa-7693-4a28-afcf-502e0b7066bb None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:07.414747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae1fa-7693-4a28-afcf-502e0b7066bb None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c/users/6e6ed487189d4e51a453825395924fe8/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:07.416965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ae1fa-7693-4a28-afcf-502e0b7066bb None admin] RBAC: Authorizing `identity:create_grant(project_id=48a104c3059e41fb968cc1394871836c, user_id=6e6ed487189d4e51a453825395924fe8, role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:07.418479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ae1fa-7693-4a28-afcf-502e0b7066bb None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:07.437958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 113/233] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:06 2022] PUT /identity/v3/projects/48a104c3059e41fb968cc1394871836c/users/6e6ed487189d4e51a453825395924fe8/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:26:07.521638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 121/234] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:07 2022] PUT /identity/v3/projects/48a104c3059e41fb968cc1394871836c/users/6e6ed487189d4e51a453825395924fe8/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:07.936313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5f928-d7bc-498b-82a0-3549b530af14 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:07.936798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5f928-d7bc-498b-82a0-3549b530af14 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:07.936798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5f928-d7bc-498b-82a0-3549b530af14 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:07.938369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 114/235] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:07.944008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83dd42-1209-4a37-85f7-6c6c821d6324 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:07.944420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83dd42-1209-4a37-85f7-6c6c821d6324 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:07.944587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83dd42-1209-4a37-85f7-6c6c821d6324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:07.969221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6a83dd42-1209-4a37-85f7-6c6c821d6324 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:07.970431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6a83dd42-1209-4a37-85f7-6c6c821d6324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:08.059080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 122/236] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:08.398576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97c53-8f8f-4258-aad1-a27f186e100f None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:08.398951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97c53-8f8f-4258-aad1-a27f186e100f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:08.399168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97c53-8f8f-4258-aad1-a27f186e100f None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.400752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 115/237] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:08.416509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11332-e67e-4dbf-ac36-815f76f84f5d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:08.416791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11332-e67e-4dbf-ac36-815f76f84f5d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:08.417065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11332-e67e-4dbf-ac36-815f76f84f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.436771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-17c11332-e67e-4dbf-ac36-815f76f84f5d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:08.437945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-17c11332-e67e-4dbf-ac36-815f76f84f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:08.514139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d97c53-8f8f-4258-aad1-a27f186e100f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:08.531434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 123/238] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:08.654767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d97c53-8f8f-4258-aad1-a27f186e100f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:08.704270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:08.704899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:08.705173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:08.705438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.724666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:08.729569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:08.730440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:08.731244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 116/239] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:08.737865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11332-e67e-4dbf-ac36-815f76f84f5d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:08.768348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:08.877949 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11332-e67e-4dbf-ac36-815f76f84f5d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:08.925068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:08.925727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:08.926005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:08.926268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.926938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:08.927798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:08.929178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:08.941123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 124/240] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:08.946819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:08.954367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:08.995859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.103593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.110473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9d397-423b-401e-b47c-e6da6eb2aff3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:09.149337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141fc25-d4ec-4c22-a79d-597fe2b3a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:09.150227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fc25-d4ec-4c22-a79d-597fe2b3a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.150857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fc25-d4ec-4c22-a79d-597fe2b3a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.151190 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fc25-d4ec-4c22-a79d-597fe2b3a2c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.153126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141fc25-d4ec-4c22-a79d-597fe2b3a2c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:09.155111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141fc25-d4ec-4c22-a79d-597fe2b3a2c3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:09.157685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 125/241] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:09.158611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74bc5-b1a1-43d6-8db3-5a96942db52f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:09.164082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768649-4b05-4379-92ed-d561d622b0ec None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.164442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768649-4b05-4379-92ed-d561d622b0ec None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.164790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768649-4b05-4379-92ed-d561d622b0ec None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.166507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 126/242] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:09.167285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768649-4b05-4379-92ed-d561d622b0ec None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:09.212671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292019d-c342-49ed-a51f-e17d82cdc9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:09.213326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292019d-c342-49ed-a51f-e17d82cdc9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.213692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292019d-c342-49ed-a51f-e17d82cdc9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.214061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292019d-c342-49ed-a51f-e17d82cdc9b6 None admin] PATH_INFO: `/v3/users/bfc7ff5bfd7247e982b7fc8282335808` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.231522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292019d-c342-49ed-a51f-e17d82cdc9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=bfc7ff5bfd7247e982b7fc8282335808)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:09.233845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292019d-c342-49ed-a51f-e17d82cdc9b6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:09.236504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 117/243] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:08 2022] GET /identity/v3/users/bfc7ff5bfd7247e982b7fc8282335808 => generated 297 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:09.240692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3825d-b3d3-444e-b823-3fadbed69b54 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.240974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3825d-b3d3-444e-b823-3fadbed69b54 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.241246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3825d-b3d3-444e-b823-3fadbed69b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.260512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-7da3825d-b3d3-444e-b823-3fadbed69b54 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:09.261875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7da3825d-b3d3-444e-b823-3fadbed69b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:09.293804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768649-4b05-4379-92ed-d561d622b0ec None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:09.329680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:09.330315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.330586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.330902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.331677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:09.333151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:09.337286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 118/244] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:09.338259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3825d-b3d3-444e-b823-3fadbed69b54 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:09.356557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.415644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.420603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 127/245] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:09 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:26:09.450607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3825d-b3d3-444e-b823-3fadbed69b54 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:09.488515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:09.489055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.489334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.490008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.563904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:09.565372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:09.578207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.641270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:09.674433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 119/246] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:09.681290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:09.767138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4ae1f-b6e5-46c8-9464-6f725607bfaf None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:09.800118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b890f-435c-4244-934f-c14d25b7989a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:09.810277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d27a7-426a-4ab9-825b-59768cd58124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:09.811493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d27a7-426a-4ab9-825b-59768cd58124 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.811976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d27a7-426a-4ab9-825b-59768cd58124 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.812438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d27a7-426a-4ab9-825b-59768cd58124 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.817590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.825061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d27a7-426a-4ab9-825b-59768cd58124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-994d27a7-426a-4ab9-825b-59768cd58124 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:09.831411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:09.833387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:09.834250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 128/247] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:09.838702 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7aafe-473f-490e-9d40-2925c98a042e None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.839191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7aafe-473f-490e-9d40-2925c98a042e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.839290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7aafe-473f-490e-9d40-2925c98a042e None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.841789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 129/248] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:09.841789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7aafe-473f-490e-9d40-2925c98a042e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:09.844058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90d7c1-2e97-439e-b04f-688437bf2e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:09.845067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d7c1-2e97-439e-b04f-688437bf2e48 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.845345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d7c1-2e97-439e-b04f-688437bf2e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.845618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90d7c1-2e97-439e-b04f-688437bf2e48 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.847006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90d7c1-2e97-439e-b04f-688437bf2e48 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:09.848528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90d7c1-2e97-439e-b04f-688437bf2e48 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:09.854468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 120/249] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:09 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:09.856038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb69b9-2e4c-43ce-8876-11b8948b510d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.856325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb69b9-2e4c-43ce-8876-11b8948b510d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.856597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb69b9-2e4c-43ce-8876-11b8948b510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.879575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-34fb69b9-2e4c-43ce-8876-11b8948b510d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:09.881406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-34fb69b9-2e4c-43ce-8876-11b8948b510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:09.925240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.967212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 121/250] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:09.968090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb69b9-2e4c-43ce-8876-11b8948b510d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:09.987123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7aafe-473f-490e-9d40-2925c98a042e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.034016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415a5aa-b0cb-4f1b-a958-aa852d9a3337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.034584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a5aa-b0cb-4f1b-a958-aa852d9a3337 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.034863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a5aa-b0cb-4f1b-a958-aa852d9a3337 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.035243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a5aa-b0cb-4f1b-a958-aa852d9a3337 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.036047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415a5aa-b0cb-4f1b-a958-aa852d9a3337 None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:10.036391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415a5aa-b0cb-4f1b-a958-aa852d9a3337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.037890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415a5aa-b0cb-4f1b-a958-aa852d9a3337 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.047454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 130/251] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:10.049560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5a4d-3637-4d95-ba80-f2ddf6b241a8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.049846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5a4d-3637-4d95-ba80-f2ddf6b241a8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.050111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5a4d-3637-4d95-ba80-f2ddf6b241a8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.051438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 131/252] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:10.053766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b5a4d-3637-4d95-ba80-f2ddf6b241a8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:10.097742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb69b9-2e4c-43ce-8876-11b8948b510d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.109267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:10.137005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219e7b8-0563-4ea2-bd8a-6af2a27b4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.137952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219e7b8-0563-4ea2-bd8a-6af2a27b4443 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.138430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219e7b8-0563-4ea2-bd8a-6af2a27b4443 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.138923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219e7b8-0563-4ea2-bd8a-6af2a27b4443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.139901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219e7b8-0563-4ea2-bd8a-6af2a27b4443 None admin] RBAC: Adding query filter params (role.id=5bedb2008a21424db91cb7ec7aff4abc, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=bfc7ff5bfd7247e982b7fc8282335808) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:10.140428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219e7b8-0563-4ea2-bd8a-6af2a27b4443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.142071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219e7b8-0563-4ea2-bd8a-6af2a27b4443 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.149341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 122/253] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:09 2022] GET /identity/v3/role_assignments?user.id=bfc7ff5bfd7247e982b7fc8282335808&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=5bedb2008a21424db91cb7ec7aff4abc => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:10.150843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947a9f7-420e-4f37-a075-df0dc2a17187 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.151420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947a9f7-420e-4f37-a075-df0dc2a17187 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.151894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947a9f7-420e-4f37-a075-df0dc2a17187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.170753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f947a9f7-420e-4f37-a075-df0dc2a17187 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:10.172324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f947a9f7-420e-4f37-a075-df0dc2a17187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:10.189803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b5a4d-3637-4d95-ba80-f2ddf6b241a8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.227585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:10.251027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.251721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.252000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.252288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] PATH_INFO: `/v3/users/59327b450b514573a4644d20dd48d74c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.253670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] RBAC: Authorizing `identity:get_user(user_id=59327b450b514573a4644d20dd48d74c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.255804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.263249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 132/254] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:10 2022] GET /identity/v3/users/59327b450b514573a4644d20dd48d74c => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:10.263249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:10.266049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 123/255] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:10.283665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947a9f7-420e-4f37-a075-df0dc2a17187 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:10.408001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947a9f7-420e-4f37-a075-df0dc2a17187 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.419493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:10.447234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.447874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.448147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.448413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.466244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:10.471105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:10.472025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:10.472813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 124/256] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:10.480085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:10.500625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec240-214a-48e3-9fc8-cd8e794ffdc8 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.550959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.551614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.552410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.552685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.557000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.558462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.569752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 133/257] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:10 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:10.570592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:10.683930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:10.688769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c23b-4cb1-47ad-b4eb-b8ae957dc465 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.730242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.730840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.731182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.731463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.732131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:10.732428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.733806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.742455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 125/258] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:10.748168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:10.749205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac035-a668-42e4-9dab-70e28af362bf None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.776631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:10.786038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.787045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.787581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.788045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c/users/59327b450b514573a4644d20dd48d74c/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.790260 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] RBAC: Authorizing `identity:create_grant(project_id=48a104c3059e41fb968cc1394871836c, user_id=59327b450b514573a4644d20dd48d74c, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.791981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.859082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b0225-514f-4118-96cf-6d05d33488df None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:10.870512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 134/259] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:10 2022] PUT /identity/v3/projects/48a104c3059e41fb968cc1394871836c/users/59327b450b514573a4644d20dd48d74c/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:10.871754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:10.907222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:10.907222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:10.907222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:10.907222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] PATH_INFO: `/v3/users/6e6ed487189d4e51a453825395924fe8` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:10.907647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] RBAC: Authorizing `identity:get_user(user_id=6e6ed487189d4e51a453825395924fe8)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:10.907647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:10.910369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 126/260] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:10 2022] GET /identity/v3/users/6e6ed487189d4e51a453825395924fe8 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:10.917116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:11.053847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.063894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4c0a-7657-474a-baa4-673e6492c24c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.103228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.103796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.104072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.104342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.136206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a676b6-4f37-4015-aa3a-f2411efb2abd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.165796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.172394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:11.174068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:11.190029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.191070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.192588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.197415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.214654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:11.221761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:11.222773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:11.223610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:11.225558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 135/261] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:11.230481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:11.341581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.359111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 127/262] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:11.366156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:11.426094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c94750-4640-4a1b-951c-6c52cf82a2c0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.485502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.486104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.486376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.486641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.487328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:11.487629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:11.489072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:11.498294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 136/263] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:11.508122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:11.579507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.581424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2527d-6349-4cf6-bf76-a4f2af948b87 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.663022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc499-b0b8-4c27-b2da-fe8690c647af None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.683920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.684777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.685206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.685631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.687026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:11.688665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:11.690786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 128/264] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:11 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:11.701978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:11.719964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.720743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.721110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.721476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] PATH_INFO: `/v3/users/6e6ed487189d4e51a453825395924fe8` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.722699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] RBAC: Authorizing `identity:get_user(user_id=6e6ed487189d4e51a453825395924fe8)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:11.727088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:11.730284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 137/265] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:11 2022] GET /identity/v3/users/6e6ed487189d4e51a453825395924fe8 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:11.735941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:11.796485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.839960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d896e-0fce-4af0-ac56-3e7669092b55 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.874967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.875632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.875964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.876237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:11.877098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] RBAC: Adding query filter params (role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=6e6ed487189d4e51a453825395924fe8) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:11.877406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:11.878955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:11.889495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 129/266] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:11 2022] GET /identity/v3/role_assignments?user.id=6e6ed487189d4e51a453825395924fe8&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:11.944202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef631-44be-4ec5-8bf0-98b1e4ed050f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:11.960580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:11.997340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:11.998403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:11.998888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:11.999397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.121321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:12.122850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:12.242416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 138/267] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:12.248379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:12.366966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c65eb6-9bfb-4012-a1b7-b3aac2341958 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:12.391592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:12.403122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbeb00-15bc-4e95-946f-bd4128db491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:12.403779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbeb00-15bc-4e95-946f-bd4128db491b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.404098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbeb00-15bc-4e95-946f-bd4128db491b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.404372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbeb00-15bc-4e95-946f-bd4128db491b None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.405482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbeb00-15bc-4e95-946f-bd4128db491b None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:12.406943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbeb00-15bc-4e95-946f-bd4128db491b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:12.408902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 130/268] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:12 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:12.415115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:12.428394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:12.504624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842a25e-aa09-473c-b05c-8a93d33d1acd None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.504934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842a25e-aa09-473c-b05c-8a93d33d1acd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.505129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842a25e-aa09-473c-b05c-8a93d33d1acd None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.506611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 131/269] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:12.511577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfc7ef-cd47-49d7-8a13-37b62e22abae None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.511902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfc7ef-cd47-49d7-8a13-37b62e22abae None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.512257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfc7ef-cd47-49d7-8a13-37b62e22abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.538254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-aacfc7ef-cd47-49d7-8a13-37b62e22abae None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:12.540302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-aacfc7ef-cd47-49d7-8a13-37b62e22abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:12.572210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a233c8-7e59-4cb9-8032-17b18f239ea1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:12.632310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7856c-7817-45c0-aee2-4c5b60002ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:12.632966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7856c-7817-45c0-aee2-4c5b60002ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.633247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7856c-7817-45c0-aee2-4c5b60002ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.633516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7856c-7817-45c0-aee2-4c5b60002ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.634309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7856c-7817-45c0-aee2-4c5b60002ea0 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=6e6ed487189d4e51a453825395924fe8) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:12.634622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7856c-7817-45c0-aee2-4c5b60002ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:12.636106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7856c-7817-45c0-aee2-4c5b60002ea0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:12.653251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 139/270] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:12 2022] GET /identity/v3/role_assignments?user.id=6e6ed487189d4e51a453825395924fe8&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:12.669750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 132/271] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:12.753690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b8f9-fd08-41be-96b6-115644a143d0 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.754007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b8f9-fd08-41be-96b6-115644a143d0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.754251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553b8f9-fd08-41be-96b6-115644a143d0 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.755751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 140/272] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:12.761440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec8fe-dcb1-4510-82a2-e7182688a5c5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:12.761728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec8fe-dcb1-4510-82a2-e7182688a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:12.761991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec8fe-dcb1-4510-82a2-e7182688a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:12.782256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9baec8fe-dcb1-4510-82a2-e7182688a5c5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:12.783469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9baec8fe-dcb1-4510-82a2-e7182688a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:12.857988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 133/273] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:12.990149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553b8f9-fd08-41be-96b6-115644a143d0 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.069148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.100587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553b8f9-fd08-41be-96b6-115644a143d0 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.102118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b0d75-f71f-423e-a27c-23f4dd096f2a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.102405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b0d75-f71f-423e-a27c-23f4dd096f2a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.102680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b0d75-f71f-423e-a27c-23f4dd096f2a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.104076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 134/274] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:13.110037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf7ab-6b87-4aaa-97f9-b508fb6b9a23 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.110313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf7ab-6b87-4aaa-97f9-b508fb6b9a23 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.110585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf7ab-6b87-4aaa-97f9-b508fb6b9a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.135629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d4faf7ab-6b87-4aaa-97f9-b508fb6b9a23 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:13.137100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d4faf7ab-6b87-4aaa-97f9-b508fb6b9a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:13.158991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.160045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.160333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.162266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.174776 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:13.180385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:13.181276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:13.182051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 141/275] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:13.182702 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.211996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.232673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 135/276] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:13.233343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faf7ab-6b87-4aaa-97f9-b508fb6b9a23 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.305749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda005-e2f9-495b-8f2f-c6168cc5be4d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.343129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.347891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faf7ab-6b87-4aaa-97f9-b508fb6b9a23 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.349501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.350205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.350559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.350892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.353130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:13.354654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:13.356553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 142/277] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:13.362692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.391635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.392559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.393207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.393764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.394647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:13.395177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:13.397797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:13.407196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 136/278] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:13.412326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.463883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.472737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5087a86-76e6-4759-a3f6-8803fe51133f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.507596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec829a-7b81-48ce-9ef5-b53b00fd7dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.508209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec829a-7b81-48ce-9ef5-b53b00fd7dd5 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.508489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec829a-7b81-48ce-9ef5-b53b00fd7dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.508766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec829a-7b81-48ce-9ef5-b53b00fd7dd5 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.509435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec829a-7b81-48ce-9ef5-b53b00fd7dd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:13.510877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec829a-7b81-48ce-9ef5-b53b00fd7dd5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:13.528282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86921-1764-4452-9f6a-369fbfbd81ce None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.563005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.563660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.566799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.566799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] PATH_INFO: `/v3/users/7f4a69bc3f644d349507cc795bc4f28f` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.578018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] RBAC: Authorizing `identity:get_user(user_id=7f4a69bc3f644d349507cc795bc4f28f)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:13.579525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:13.581258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 137/279] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:13 2022] GET /identity/v3/users/7f4a69bc3f644d349507cc795bc4f28f => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:13.587230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.610822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 143/280] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:13 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:26:13.612254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7dd8c-8016-484f-bb75-eadb72637e79 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.612538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7dd8c-8016-484f-bb75-eadb72637e79 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.612811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7dd8c-8016-484f-bb75-eadb72637e79 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.614045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 144/281] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:13.614846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7dd8c-8016-484f-bb75-eadb72637e79 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.691147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.705068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228a7f-1fad-45cd-9c06-2eab0dfcc223 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.706796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.743517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7dd8c-8016-484f-bb75-eadb72637e79 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.745746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781616a5-bb2e-45c2-b774-db19e04b8760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.746648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781616a5-bb2e-45c2-b774-db19e04b8760 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.746944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781616a5-bb2e-45c2-b774-db19e04b8760 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.747238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781616a5-bb2e-45c2-b774-db19e04b8760 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.760712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781616a5-bb2e-45c2-b774-db19e04b8760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-781616a5-bb2e-45c2-b774-db19e04b8760 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:13.766046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:13.766938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 138/282] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:13.768491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdf671-3529-4b05-80c0-eb55848d700e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.769389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdf671-3529-4b05-80c0-eb55848d700e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.769389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdf671-3529-4b05-80c0-eb55848d700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.789630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.790507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.790786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.791060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.791533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-afcdf671-3529-4b05-80c0-eb55848d700e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:13.791873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, user.id=7f4a69bc3f644d349507cc795bc4f28f, scope.system=all) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:13.792182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:13.792743 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-afcdf671-3529-4b05-80c0-eb55848d700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:13.794326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:13.800036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 145/283] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 1 16:26:13 2022] GET /identity/v3/role_assignments?user.id=7f4a69bc3f644d349507cc795bc4f28f&scope.system=all&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:13.800749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:13.895018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 139/284] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:13.945547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665daae0-c0b0-4956-b2f7-739fbfbe511a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:13.969754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:13.984846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:13.985452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.985729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.986002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.986672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:13.986973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:13.988422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:14.000189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 146/285] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:14.006191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdf671-3529-4b05-80c0-eb55848d700e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.106002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:14.116515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdf671-3529-4b05-80c0-eb55848d700e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.153386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.153956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.154236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.154513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] PATH_INFO: `/v3/users/bfc7ff5bfd7247e982b7fc8282335808` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.155681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] RBAC: Authorizing `identity:get_user(user_id=bfc7ff5bfd7247e982b7fc8282335808)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:14.157130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:14.159077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 140/286] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/users/bfc7ff5bfd7247e982b7fc8282335808 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:14.164479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.211440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.355351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08395c-3441-4ce2-adae-8da4eabd8068 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.418577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08143e-51c0-4db2-844e-0def0b60b785 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.433384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.434019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.434295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.434570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.437362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:14.438821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:14.441640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 147/287] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:14.448072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.490701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.491366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.491644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.491910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.510751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:14.520681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:14.521549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:14.522622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 141/288] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:14.527851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.554958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:14.562451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:14.626396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955390a-3be0-476d-a175-5737d1fca43a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.682600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.684232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.684516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.684790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c/users/bfc7ff5bfd7247e982b7fc8282335808/roles/5bedb2008a21424db91cb7ec7aff4abc` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.688589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] RBAC: Authorizing `identity:create_grant(project_id=48a104c3059e41fb968cc1394871836c, user_id=bfc7ff5bfd7247e982b7fc8282335808, role_id=5bedb2008a21424db91cb7ec7aff4abc)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:14.690044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:14.702791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a408450-7fd7-438a-9dcd-fefa2c8b9998 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.740008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.740697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.741073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.741353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.742022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] RBAC: Adding query filter params (name=member) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:14.742325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:14.743833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:14.752825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 142/289] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:14.758165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.768506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 148/290] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:14 2022] PUT /identity/v3/projects/48a104c3059e41fb968cc1394871836c/users/bfc7ff5bfd7247e982b7fc8282335808/roles/5bedb2008a21424db91cb7ec7aff4abc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:14.907539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:14.916403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e580c6-f5cf-4ccf-bd55-97629f6b256d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.952721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.953275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.953550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.953822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] PATH_INFO: `/v3/users/59327b450b514573a4644d20dd48d74c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.954957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] RBAC: Authorizing `identity:get_user(user_id=59327b450b514573a4644d20dd48d74c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:14.956560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:14.958468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 143/291] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/users/59327b450b514573a4644d20dd48d74c => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:14.964325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:15.085618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11955-71aa-4baa-96f8-ba94bacd260a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:15.111543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:15.125864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:15.126447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:15.126724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:15.126991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:15.227522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:15.228936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:15.411788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 149/292] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:15.417574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:15.534771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86075-18fd-47bf-8136-b7022a17b1ac None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:15.577511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20136a26-8fa0-4ec7-9cbf-f0d9b29dd1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:15.578140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20136a26-8fa0-4ec7-9cbf-f0d9b29dd1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:15.578413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20136a26-8fa0-4ec7-9cbf-f0d9b29dd1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:15.578679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20136a26-8fa0-4ec7-9cbf-f0d9b29dd1b8 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:15.584304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20136a26-8fa0-4ec7-9cbf-f0d9b29dd1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:15.585744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20136a26-8fa0-4ec7-9cbf-f0d9b29dd1b8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:15.587411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 144/293] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:15 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:15.593547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:15.614721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:15.746821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d16b-4a1e-4b2c-afb1-06677c96cd3d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:15.790667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0208b-c975-41be-a4c4-615ce2f2ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:15.791220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0208b-c975-41be-a4c4-615ce2f2ec98 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:15.791500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0208b-c975-41be-a4c4-615ce2f2ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:15.791771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0208b-c975-41be-a4c4-615ce2f2ec98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:15.792510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0208b-c975-41be-a4c4-615ce2f2ec98 None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=59327b450b514573a4644d20dd48d74c) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:15.792820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0208b-c975-41be-a4c4-615ce2f2ec98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:15.794308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0208b-c975-41be-a4c4-615ce2f2ec98 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:15.800879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 150/294] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:15 2022] GET /identity/v3/role_assignments?user.id=59327b450b514573a4644d20dd48d74c&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:16.067661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33c87-7120-4612-ab92-4ba0d3fdb723 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.068025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33c87-7120-4612-ab92-4ba0d3fdb723 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.068127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33c87-7120-4612-ab92-4ba0d3fdb723 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.069770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 145/295] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:16.075700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8ef9-61b3-4653-9841-7f8b2b7dd3a1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.075985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8ef9-61b3-4653-9841-7f8b2b7dd3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.076258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8ef9-61b3-4653-9841-7f8b2b7dd3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.098001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3fed8ef9-61b3-4653-9841-7f8b2b7dd3a1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:16.099766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3fed8ef9-61b3-4653-9841-7f8b2b7dd3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:16.173052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 151/296] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:16.196425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd252f8-6ca3-4af6-b329-39a0aa5bf382 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.196733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd252f8-6ca3-4af6-b329-39a0aa5bf382 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.196977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd252f8-6ca3-4af6-b329-39a0aa5bf382 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.198337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 146/297] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:16.203585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8237a-e3a7-4c31-9bd6-7a27a7a4e0c8 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.203871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8237a-e3a7-4c31-9bd6-7a27a7a4e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.204150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8237a-e3a7-4c31-9bd6-7a27a7a4e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.213951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:16.229195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-47a8237a-e3a7-4c31-9bd6-7a27a7a4e0c8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:16.230440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-47a8237a-e3a7-4c31-9bd6-7a27a7a4e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:16.297428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b5d5-df69-46c2-9093-2b7b1161bb65 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.297742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b5d5-df69-46c2-9093-2b7b1161bb65 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.297976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b5d5-df69-46c2-9093-2b7b1161bb65 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.300418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 147/298] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:16.306109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce370d-f297-4043-bc88-3e759bf4081e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.306421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce370d-f297-4043-bc88-3e759bf4081e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.306736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce370d-f297-4043-bc88-3e759bf4081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.310545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 152/299] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:16.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-89ce370d-f297-4043-bc88-3e759bf4081e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:16.333193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-89ce370d-f297-4043-bc88-3e759bf4081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:16.349834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:16.412271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 148/300] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:16.490330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8237a-e3a7-4c31-9bd6-7a27a7a4e0c8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:16.594924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8237a-e3a7-4c31-9bd6-7a27a7a4e0c8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:16.605436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce370d-f297-4043-bc88-3e759bf4081e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:16.636920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:16.637868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.638146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.638412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.641424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:16.652610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:16.657808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:16.658694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:16.659494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 153/301] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:16.665430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:16.730995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce370d-f297-4043-bc88-3e759bf4081e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:16.766462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:16.767084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.767397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.767659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.778454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:16.783417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:16.784309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:16.785535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 149/302] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:16.786920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839b150-1723-4a22-8dc0-89ffc42a6da9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:16.786994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:16.798142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:16.835354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:16.835944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.836349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.836992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.837786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:16.838304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:16.839978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:16.849332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 154/303] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:16.854358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:16.897683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee2ad-a7c1-46a7-823d-f1b07599b4f4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:16.914232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:16.931664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:16.932293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:16.932569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:16.932838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:16.933944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:16.935521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:16.937240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 150/304] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:16.937823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:16.974229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546e3b1-1b87-44f0-b206-9af7c26c1856 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.017276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.017888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.018179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.018431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.019212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:17.019520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:17.021519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:17.035101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 155/305] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:17.036518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:17.041072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.066379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e374ed-0f30-4243-ba5d-33883f357e82 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.105468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.106578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.107078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.107586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] PATH_INFO: `/v3/users/7f4a69bc3f644d349507cc795bc4f28f` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.108795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] RBAC: Authorizing `identity:get_user(user_id=7f4a69bc3f644d349507cc795bc4f28f)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:17.110292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:17.112050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 151/306] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:16 2022] GET /identity/v3/users/7f4a69bc3f644d349507cc795bc4f28f => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:17.116086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:17.144522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53f6a0-6218-4c3f-94b1-fc4cb4c499cc None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.163123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.181030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.181643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.181921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.182194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] PATH_INFO: `/v3/groups` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.182822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:17.184306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:17.223255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b605-2e7f-479e-9f65-3938ae7e6f7f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.263646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90092e56-e57f-4bb1-a727-d33a980272cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.264284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092e56-e57f-4bb1-a727-d33a980272cb None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.264556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092e56-e57f-4bb1-a727-d33a980272cb None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.264827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092e56-e57f-4bb1-a727-d33a980272cb None admin] PATH_INFO: `/v3/users/f53269ddc8f14bea86cb9fa91841fc50` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.278745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90092e56-e57f-4bb1-a727-d33a980272cb None admin] RBAC: Authorizing `identity:get_user(user_id=f53269ddc8f14bea86cb9fa91841fc50)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:17.280295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90092e56-e57f-4bb1-a727-d33a980272cb None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:17.282120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 152/307] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:17 2022] GET /identity/v3/users/f53269ddc8f14bea86cb9fa91841fc50 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:17.287216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 156/308] 10.222.0.69 () {60 vars in 1134 bytes} [Thu Sep 1 16:26:17 2022] POST /identity/v3/groups => generated 229 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:17.287216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:17.290661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94dc3d-4d46-494b-b008-23dbbe311f08 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.290661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94dc3d-4d46-494b-b008-23dbbe311f08 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.290661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94dc3d-4d46-494b-b008-23dbbe311f08 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.290661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 153/309] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:17.290963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94dc3d-4d46-494b-b008-23dbbe311f08 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:17.300141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.411488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0ef1-0a75-4e66-891f-eaf8ba47f7cf None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.416673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94dc3d-4d46-494b-b008-23dbbe311f08 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.453018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.453018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.453303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.453391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] PATH_INFO: `/v3/system/users/7f4a69bc3f644d349507cc795bc4f28f/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.454808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7f4a69bc3f644d349507cc795bc4f28f, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:17.456222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:17.461445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bff32-77ba-42ff-b1a4-40cfb32c6745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.462060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bff32-77ba-42ff-b1a4-40cfb32c6745 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.462338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bff32-77ba-42ff-b1a4-40cfb32c6745 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.462614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bff32-77ba-42ff-b1a4-40cfb32c6745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.463383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bff32-77ba-42ff-b1a4-40cfb32c6745 None admin] RBAC: Adding query filter params (role.id=5bedb2008a21424db91cb7ec7aff4abc, user.id=f53269ddc8f14bea86cb9fa91841fc50, scope.system=all) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:17.463692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bff32-77ba-42ff-b1a4-40cfb32c6745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:17.465113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bff32-77ba-42ff-b1a4-40cfb32c6745 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:17.470636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 154/310] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 1 16:26:17 2022] GET /identity/v3/role_assignments?user.id=f53269ddc8f14bea86cb9fa91841fc50&scope.system=all&role.id=5bedb2008a21424db91cb7ec7aff4abc => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:17.471605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1acd4-bc71-4f27-ab98-c3929da1a950 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.471881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1acd4-bc71-4f27-ab98-c3929da1a950 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.472151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1acd4-bc71-4f27-ab98-c3929da1a950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:17.491709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-26b1acd4-bc71-4f27-ab98-c3929da1a950 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:17.492946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-26b1acd4-bc71-4f27-ab98-c3929da1a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:17.565521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.566918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 157/311] 10.222.0.69 () {58 vars in 1334 bytes} [Thu Sep 1 16:26:17 2022] PUT /identity/v3/system/users/7f4a69bc3f644d349507cc795bc4f28f/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:17.582773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 155/312] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:17.853648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:17.898706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:17.960230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf9987-31d5-4e2a-b5a1-a350126cba00 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:17.995978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:17.996609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:17.996888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:17.997162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.008283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:18.013677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:18.014545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:18.015360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 158/313] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:18.020624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1acd4-bc71-4f27-ab98-c3929da1a950 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:18.124121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1acd4-bc71-4f27-ab98-c3929da1a950 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:18.158837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:18.159468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.159747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.160018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.160674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:18.161002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:18.162370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:18.170826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 156/314] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:18.176006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:18.280356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3d54b-4c18-43ec-b689-d84ac4dc618e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:18.281878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:18.315028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:18.315761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.316041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.316318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] PATH_INFO: `/v3/users/bfc7ff5bfd7247e982b7fc8282335808` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.317560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=bfc7ff5bfd7247e982b7fc8282335808)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:18.319070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:18.326058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 159/315] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:18 2022] GET /identity/v3/users/bfc7ff5bfd7247e982b7fc8282335808 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:18.327032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:18.391102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:18.434274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40296c-def5-43c7-9354-5a82d0d8d9f4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:18.470736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:18.471382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.471656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.471925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.541644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:18.543115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:18.600301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:18.644962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 157/316] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:18.651022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:18.762594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb3a25-61e9-44b2-ad7d-cf8b611dc3b3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:18.798514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f2a3c-b134-4f23-bba6-c5982e5682e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:18.799175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2a3c-b134-4f23-bba6-c5982e5682e6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.799485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2a3c-b134-4f23-bba6-c5982e5682e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.799762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2a3c-b134-4f23-bba6-c5982e5682e6 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.800900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f2a3c-b134-4f23-bba6-c5982e5682e6 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:18.802373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f2a3c-b134-4f23-bba6-c5982e5682e6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:18.804336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 160/317] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:18 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:18.812260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:18.912540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55241bb8-1eed-400c-adba-5b700148b8da None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:18.960283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5fae1-af4b-49fd-94aa-337f33dea267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:18.960884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5fae1-af4b-49fd-94aa-337f33dea267 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.961159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5fae1-af4b-49fd-94aa-337f33dea267 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.961425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5fae1-af4b-49fd-94aa-337f33dea267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.962157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5fae1-af4b-49fd-94aa-337f33dea267 None admin] RBAC: Adding query filter params (role.id=5bedb2008a21424db91cb7ec7aff4abc, scope.project.id=48a104c3059e41fb968cc1394871836c, user.id=bfc7ff5bfd7247e982b7fc8282335808) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:18.962460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5fae1-af4b-49fd-94aa-337f33dea267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:18.963921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5fae1-af4b-49fd-94aa-337f33dea267 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:18.970119 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 158/318] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:18 2022] GET /identity/v3/role_assignments?user.id=bfc7ff5bfd7247e982b7fc8282335808&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=5bedb2008a21424db91cb7ec7aff4abc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:19.325061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41880432-ada8-461b-8ada-fe1cd4d67c35 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.325455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41880432-ada8-461b-8ada-fe1cd4d67c35 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.325632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41880432-ada8-461b-8ada-fe1cd4d67c35 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.326998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 161/319] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:19.332025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6916a4-f561-47e7-8b1f-e82fcfdc030e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.332464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6916a4-f561-47e7-8b1f-e82fcfdc030e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.332625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6916a4-f561-47e7-8b1f-e82fcfdc030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.350903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-bd6916a4-f561-47e7-8b1f-e82fcfdc030e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:19.352136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bd6916a4-f561-47e7-8b1f-e82fcfdc030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.369410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:19.420513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 159/320] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:19.513137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816062b-89b2-41cb-bfbb-d6571f590866 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.513448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816062b-89b2-41cb-bfbb-d6571f590866 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.513682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816062b-89b2-41cb-bfbb-d6571f590866 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.515171 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 162/321] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:19.520061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee94a5-3c15-4b15-b2e6-207e111a7e3b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.520379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee94a5-3c15-4b15-b2e6-207e111a7e3b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.520646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee94a5-3c15-4b15-b2e6-207e111a7e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.538662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-daee94a5-3c15-4b15-b2e6-207e111a7e3b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:19.539870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-daee94a5-3c15-4b15-b2e6-207e111a7e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.579445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189e61d-1c5e-4a38-ac60-5e4572fb2541 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.579725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189e61d-1c5e-4a38-ac60-5e4572fb2541 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.580024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189e61d-1c5e-4a38-ac60-5e4572fb2541 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.581343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 163/322] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:19.586535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ca936-6800-4093-9b32-07a54da39ffb None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.586818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ca936-6800-4093-9b32-07a54da39ffb None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.587093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ca936-6800-4093-9b32-07a54da39ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.608184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2f9ca936-6800-4093-9b32-07a54da39ffb None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:19.609370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2f9ca936-6800-4093-9b32-07a54da39ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.609767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 160/323] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:19.648242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:19.695939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 164/324] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:19.700269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee94a5-3c15-4b15-b2e6-207e111a7e3b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:19.780586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:19.799074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee94a5-3c15-4b15-b2e6-207e111a7e3b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:19.833397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:19.833953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.834231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.834498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.835619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:19.837047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:19.838760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 161/325] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:19.844090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ca936-6800-4093-9b32-07a54da39ffb None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:19.882359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:19.955809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ca936-6800-4093-9b32-07a54da39ffb None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:19.986924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5eb26-9c48-4ddc-87b8-bf7841ea855c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:19.996793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:19.997414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.997689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.997961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] PATH_INFO: `/v3/groups` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.998596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:20.000073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:20.023717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.024337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.024610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.027561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.034626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:20.040310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:20.041339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:20.042117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 162/326] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:20.042778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.055449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:20.111295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 165/327] 10.222.0.69 () {60 vars in 1134 bytes} [Thu Sep 1 16:26:19 2022] POST /identity/v3/groups => generated 226 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:20.111295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.142368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:20.146766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d23c7-c4e2-47a0-b500-c60edd458e22 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.187684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.188411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.188686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.189159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.200567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:20.205926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:20.208526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:20.209562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 163/328] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:20.213837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.237927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e68c-f0cf-416c-9d30-4bcc3acdf43b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.280173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.281164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.281568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.281845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.282517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:20.282821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:20.284289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:20.293147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 166/329] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:20.298695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.298846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:20.338967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47471a1-3c90-45b2-9bd2-a49f2a7c714a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.379999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.380535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.380802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.381070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.381731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] RBAC: Adding query filter params (name=member) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:20.382027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:20.383437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:20.392837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 164/330] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:20.399382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.412413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:20.423949 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d447ed-6e4f-4548-9629-e1fc48833c7c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.472056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.473881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.474961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.475264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] PATH_INFO: `/v3/users/f53269ddc8f14bea86cb9fa91841fc50` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.476416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] RBAC: Authorizing `identity:get_user(user_id=f53269ddc8f14bea86cb9fa91841fc50)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:20.477933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:20.479866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 167/331] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:20 2022] GET /identity/v3/users/f53269ddc8f14bea86cb9fa91841fc50 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:20.485127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.524721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360bab7-90c7-4219-ad49-787a8018c78b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.568500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:20.576420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.577498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.577498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.577680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] PATH_INFO: `/v3/users/7f4a69bc3f644d349507cc795bc4f28f` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.578810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] RBAC: Authorizing `identity:get_user(user_id=7f4a69bc3f644d349507cc795bc4f28f)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:20.580288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:20.582156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 165/332] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:20 2022] GET /identity/v3/users/7f4a69bc3f644d349507cc795bc4f28f => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:20.590529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:20.623648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415acf74-063a-4b28-acf4-0c58c6407784 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.680115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb43874-3745-4940-833e-2060bfbcccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.680784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb43874-3745-4940-833e-2060bfbcccd1 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.681296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb43874-3745-4940-833e-2060bfbcccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.681575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb43874-3745-4940-833e-2060bfbcccd1 None admin] PATH_INFO: `/v3/system/users/f53269ddc8f14bea86cb9fa91841fc50/roles/5bedb2008a21424db91cb7ec7aff4abc` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.684167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb43874-3745-4940-833e-2060bfbcccd1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f53269ddc8f14bea86cb9fa91841fc50, role_id=5bedb2008a21424db91cb7ec7aff4abc)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:20.686525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb43874-3745-4940-833e-2060bfbcccd1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:20.729081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c988-eb9d-4ab5-83e1-89c7a1fad0fa None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:20.748255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 168/333] 10.222.0.69 () {58 vars in 1334 bytes} [Thu Sep 1 16:26:20 2022] PUT /identity/v3/system/users/f53269ddc8f14bea86cb9fa91841fc50/roles/5bedb2008a21424db91cb7ec7aff4abc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:20.773107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd03c91-3cda-429a-9c3e-f39a4d5da9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:20.774017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03c91-3cda-429a-9c3e-f39a4d5da9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:20.774439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03c91-3cda-429a-9c3e-f39a4d5da9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:20.774852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03c91-3cda-429a-9c3e-f39a4d5da9b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:20.775796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd03c91-3cda-429a-9c3e-f39a4d5da9b4 None admin] RBAC: Adding query filter params (role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, user.id=7f4a69bc3f644d349507cc795bc4f28f, scope.system=all) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:20.776507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd03c91-3cda-429a-9c3e-f39a4d5da9b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:20.778169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd03c91-3cda-429a-9c3e-f39a4d5da9b4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:20.792746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 166/334] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 1 16:26:20 2022] GET /identity/v3/role_assignments?user.id=7f4a69bc3f644d349507cc795bc4f28f&scope.system=all&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:22.291311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb8ff-f961-424c-b113-740a47e6b132 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:22.292340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb8ff-f961-424c-b113-740a47e6b132 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:22.292837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb8ff-f961-424c-b113-740a47e6b132 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:22.294452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 169/335] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:22.303018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a80e8-1361-474f-84f4-e186c340078d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:22.303967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a80e8-1361-474f-84f4-e186c340078d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:22.304405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a80e8-1361-474f-84f4-e186c340078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:22.325863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a90a80e8-1361-474f-84f4-e186c340078d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:22.327354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a90a80e8-1361-474f-84f4-e186c340078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:22.404194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:22.419763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 167/336] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:22.969513 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb8ff-f961-424c-b113-740a47e6b132 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:23.000149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:23.049080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d75b6c-41fe-4e34-8bc4-404fbac61696 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.049406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d75b6c-41fe-4e34-8bc4-404fbac61696 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.049622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d75b6c-41fe-4e34-8bc4-404fbac61696 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.051213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 168/337] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:23.056656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647820-8c23-4378-955e-cebb0fb63690 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.056937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647820-8c23-4378-955e-cebb0fb63690 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.057198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647820-8c23-4378-955e-cebb0fb63690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.085776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d8647820-8c23-4378-955e-cebb0fb63690 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:23.086978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d8647820-8c23-4378-955e-cebb0fb63690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:23.136638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb8ff-f961-424c-b113-740a47e6b132 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:23.206940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:23.208227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.208584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.208854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.216598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 169/338] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:23.217866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b075022-36bc-4cda-838b-eabe8d0f4691 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.218148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b075022-36bc-4cda-838b-eabe8d0f4691 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.218417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b075022-36bc-4cda-838b-eabe8d0f4691 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.219896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 170/339] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:23.227060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c239b-9584-408c-9605-2c8bc92a2aa4 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.227363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c239b-9584-408c-9605-2c8bc92a2aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.227684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c239b-9584-408c-9605-2c8bc92a2aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.234026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:23.239439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:23.240307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:23.241084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 170/340] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:23.246348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:23.271214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f43c239b-9584-408c-9605-2c8bc92a2aa4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:23.272683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f43c239b-9584-408c-9605-2c8bc92a2aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:23.345955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:23.366724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ffaca-34f0-47b1-baf0-df1035fff6b0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:23.384702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 171/341] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:23.386282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493897d6-0193-46ec-b1ed-b929562921cc None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.387597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493897d6-0193-46ec-b1ed-b929562921cc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.387879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493897d6-0193-46ec-b1ed-b929562921cc None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.398530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 172/342] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:23.398855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b4dd4-bc39-46c4-9496-00ae1dc4a15f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.399131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b4dd4-bc39-46c4-9496-00ae1dc4a15f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.399437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b4dd4-bc39-46c4-9496-00ae1dc4a15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.430104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:23.432615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.432615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.432615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.434293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ea7b4dd4-bc39-46c4-9496-00ae1dc4a15f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:23.435222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:23.435538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:23.437010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ea7b4dd4-bc39-46c4-9496-00ae1dc4a15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:23.438738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:23.459649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 171/343] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:23.465423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:23.498409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:23.531731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 173/344] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:23.600857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b4dd4-bc39-46c4-9496-00ae1dc4a15f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:23.617587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e5f2-9503-4bd6-a46c-c225a3ad467e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:23.664025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:23.664656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.664941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.665268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.687555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:23.791630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:23.793131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:23.798261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b4dd4-bc39-46c4-9496-00ae1dc4a15f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:23.842855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:23.844040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:23.844466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:23.845147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:23.861197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:23.866916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:23.868029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:26:23.869003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:23.871251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 174/345] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:23.877929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:23.952219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.010292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 172/346] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:26:24.011187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.025524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd964b-ea0a-4d08-9ea4-992ee32a5905 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.069869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.070407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.070685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.070955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.072571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:24.072571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:24.074380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:24.089026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 175/347] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:24.090142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.103443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.170024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f179f-098e-4e90-87fb-de6903d63717 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.202454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef116-d0ca-4990-bfc2-314af9370e7d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.205731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.206343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.207176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.207285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.208075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.218810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:24.225451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:24.226997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 173/348] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:24.228146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.241435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.242079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.242361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.242634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.244010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:24.245615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:24.247737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 176/349] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:24.248987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.347091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498db376-6548-47a4-9e6d-c99f34ee82d9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.351010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.372471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3e6e-583c-439a-b014-13e50c133c7a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.398569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.399846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.400365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.401059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.413402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:24.415614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.416252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.416532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.416803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] PATH_INFO: `/v3/users/f53269ddc8f14bea86cb9fa91841fc50` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.417945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] RBAC: Authorizing `identity:get_user(user_id=f53269ddc8f14bea86cb9fa91841fc50)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:24.418699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:24.419610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:24.420456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:24.421052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:24.421120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 174/350] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:24.421120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.424207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 177/351] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/users/f53269ddc8f14bea86cb9fa91841fc50 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:24.425001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.468414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.554171 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077af38-2e0d-4b9a-a316-eac6091a69b2 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.555942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f66cb1-3ba1-43ce-809b-90eadcbb7d30 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.602702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.602883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41ba8-dae8-47da-a184-0dcb988e994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.606022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.606133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41ba8-dae8-47da-a184-0dcb988e994e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.606205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.606286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41ba8-dae8-47da-a184-0dcb988e994e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.606366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.606435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41ba8-dae8-47da-a184-0dcb988e994e None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.606435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41ba8-dae8-47da-a184-0dcb988e994e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:24.606435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41ba8-dae8-47da-a184-0dcb988e994e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:24.606435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41ba8-dae8-47da-a184-0dcb988e994e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:24.615619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:24.616684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 175/352] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:24.617139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:24.617912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34998b02-663b-4cd5-b88d-709b3270014b None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.618210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34998b02-663b-4cd5-b88d-709b3270014b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.618470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34998b02-663b-4cd5-b88d-709b3270014b None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.619096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 178/353] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:24.619877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.619982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 176/354] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:24.620864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34998b02-663b-4cd5-b88d-709b3270014b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.659108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.742856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.746048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d202e-5437-45b4-8dbc-92563b1d4a88 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.761637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34998b02-663b-4cd5-b88d-709b3270014b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.786520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.787243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.787535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.787802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.788473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] RBAC: Adding query filter params (name=member) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:24.788772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:24.790142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:24.800688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 179/355] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:24.804243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cb1cf-1feb-4de3-ab79-f1e069b5e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.804374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.805143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb1cf-1feb-4de3-ab79-f1e069b5e3af None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.805678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb1cf-1feb-4de3-ab79-f1e069b5e3af None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.805955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb1cf-1feb-4de3-ab79-f1e069b5e3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.806839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cb1cf-1feb-4de3-ab79-f1e069b5e3af None admin] RBAC: Adding query filter params (role.id=5bedb2008a21424db91cb7ec7aff4abc, user.id=f53269ddc8f14bea86cb9fa91841fc50, scope.system=all) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:24.807011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cb1cf-1feb-4de3-ab79-f1e069b5e3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:24.808439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cb1cf-1feb-4de3-ab79-f1e069b5e3af None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:24.822755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 177/356] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/role_assignments?user.id=f53269ddc8f14bea86cb9fa91841fc50&scope.system=all&role.id=5bedb2008a21424db91cb7ec7aff4abc => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:24.824143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7696-d468-4d00-bb5d-bc5ab226f5dd None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.824429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7696-d468-4d00-bb5d-bc5ab226f5dd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.824713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7696-d468-4d00-bb5d-bc5ab226f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.846850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-cfae7696-d468-4d00-bb5d-bc5ab226f5dd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:24.849830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cfae7696-d468-4d00-bb5d-bc5ab226f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:24.936867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 178/357] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:24.938025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae7696-d468-4d00-bb5d-bc5ab226f5dd None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:24.944878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84147de1-0205-4baa-a294-7e80fedd6bcd None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:24.958563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:24.994027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851eb69-ec33-4946-993f-71f1278b5ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:24.995029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851eb69-ec33-4946-993f-71f1278b5ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.996033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851eb69-ec33-4946-993f-71f1278b5ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.996531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851eb69-ec33-4946-993f-71f1278b5ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.037168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.080542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae7696-d468-4d00-bb5d-bc5ab226f5dd None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.098514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851eb69-ec33-4946-993f-71f1278b5ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.100157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851eb69-ec33-4946-993f-71f1278b5ea7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:25.129153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.130297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.130565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.130828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.132102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=7e48431aba38408c99d6522a99cbbdbd) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:25.132372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.133799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:25.141183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 179/358] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:25.142874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.227551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 180/359] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:25.229204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72052ef8-b4ac-4269-aae0-4e4646441362 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.229662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72052ef8-b4ac-4269-aae0-4e4646441362 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.230106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72052ef8-b4ac-4269-aae0-4e4646441362 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.232048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 181/360] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:25.236311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72052ef8-b4ac-4269-aae0-4e4646441362 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.244928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.282161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226473-1e00-4458-be63-57c2c964ebc8 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.323313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.323799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.324717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.324985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.325264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.386394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72052ef8-b4ac-4269-aae0-4e4646441362 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.419549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.421690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:25.427383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539bb1-bea4-4a9d-b238-c04ab14e1aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.428020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539bb1-bea4-4a9d-b238-c04ab14e1aba None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.428298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539bb1-bea4-4a9d-b238-c04ab14e1aba None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.428565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539bb1-bea4-4a9d-b238-c04ab14e1aba None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.429710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539bb1-bea4-4a9d-b238-c04ab14e1aba None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.431148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539bb1-bea4-4a9d-b238-c04ab14e1aba None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:25.433669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 182/361] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:25.434246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ebc0-615d-4917-949f-eb91aacb14b1 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.434622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ebc0-615d-4917-949f-eb91aacb14b1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.434869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ebc0-615d-4917-949f-eb91aacb14b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.455632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4487ebc0-615d-4917-949f-eb91aacb14b1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:25.457341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4487ebc0-615d-4917-949f-eb91aacb14b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:25.518592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.547792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 183/362] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:25.548979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487ebc0-615d-4917-949f-eb91aacb14b1 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.554786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 180/363] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:25.555919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.630937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.675547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3c819-bac4-4bc9-b676-0f1fee0fcdf5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.683621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487ebc0-615d-4917-949f-eb91aacb14b1 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.722159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.722627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.723088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.723675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.724091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.724298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.724530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.724862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.726131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.728504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:25.730540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 181/364] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:25.731475 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.748986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:25.754142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:25.755656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:25.756445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 184/365] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:25.758879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.802157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.863234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702390e-9a05-470a-9a06-97cacc12d10b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.873597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af62f4d-e289-42f1-bd40-38626b9ff8c5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.906319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.909467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.910098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.910366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.910705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.911855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.913359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:25.915046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 182/366] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:25.915971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.923203 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.923950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.924128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.924361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.925555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=7e48431aba38408c99d6522a99cbbdbd) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:25.925866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.927782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:25.935073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 185/367] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:25.936251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.062538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750910-7f7e-42d9-9a2b-80a8c38532d8 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.074033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3e0dc-59f5-42c6-a438-6938d807b728 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.082578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:26.111411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.112067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.112346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.112621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.113295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:26.114411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.116546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.125420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.126245 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 183/368] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:26.126876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.127140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.127683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.128148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.142599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:26.150295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:26.151169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:26.151976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:26.154351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 186/369] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:26.161343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.217071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:26.256743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7bc0a-6483-4e6e-88ee-d3c9fb5f0906 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.287948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4669-f515-402e-bd7f-bd6840a9d7fe None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.307745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.308672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.308952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.309228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.310734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.312236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.314720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 184/370] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:26.319042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.338851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.339850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.340327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.340842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.376701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:26.427398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.429185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.445372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b314f-3570-4c4e-ac90-219c102d61f9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.485712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:26.492066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.493054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.493525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.493951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.494780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:26.495325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.499564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.509994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 185/371] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:26.511587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.558278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 187/372] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:26.559248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.621902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453472c-36fa-42bd-8209-73136cb4804f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.629032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:26.668297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.668615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf9971-3035-4c58-9535-3fa8646f4abe None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.669318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.669754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.670166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.671047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=48a104c3059e41fb968cc1394871836c) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:26.671519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.673123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.680513 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 186/373] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:26.681529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.720935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.721328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.721610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.721922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.745370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:26.794800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1f30-e01a-4d3b-8169-6b8a62ebecc8 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:26.826750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.832652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.833832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:26.834637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:26.835061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:26.835526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:26.836841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:26.838442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.840325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 187/374] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:26.848646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:26.897606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:27.005387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 188/375] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:27.011737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:27.029491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcdd85-8a0b-4925-aa97-017dfc96487c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:27.075511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:27.085292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:27.085936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:27.086217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:27.086495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:27.087698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:27.089162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:27.091589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 188/376] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:26 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:27.098818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:27.175429 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714466a-50e0-4e2c-93c8-90d4fedc06c2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:27.224343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:27.224997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:27.225283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:27.225561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] PATH_INFO: `/v3/projects/17429cdb686a41f6a3cf51eb7ac21844` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:27.227090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] RBAC: Authorizing `identity:get_project(project_id=17429cdb686a41f6a3cf51eb7ac21844)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:27.228643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:27.234846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 189/377] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:27 2022] GET /identity/v3/projects/17429cdb686a41f6a3cf51eb7ac21844 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:27.237341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:27.295336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aab8a-9e69-42f5-9b83-b1f1bb87c8c3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:27.308141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:27.336413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5466239-7701-484c-a437-300347f83ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:27.337086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5466239-7701-484c-a437-300347f83ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:27.337646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5466239-7701-484c-a437-300347f83ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:27.337918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5466239-7701-484c-a437-300347f83ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:27.338650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5466239-7701-484c-a437-300347f83ca6 None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=48a104c3059e41fb968cc1394871836c) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:27.338956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5466239-7701-484c-a437-300347f83ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:27.340441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5466239-7701-484c-a437-300347f83ca6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:27.348719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 189/378] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:27 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:27.350001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe3ce-867c-4743-bd5d-4f19fd09dd61 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:27.350283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe3ce-867c-4743-bd5d-4f19fd09dd61 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:27.350557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe3ce-867c-4743-bd5d-4f19fd09dd61 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:27.352156 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 190/379] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:27.369124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90074e36-0694-455b-8536-7e69657582f1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:27.369481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90074e36-0694-455b-8536-7e69657582f1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:27.369762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90074e36-0694-455b-8536-7e69657582f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:27.382427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e227fd0-63b9-42ca-8aa3-7fffd2262c75 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:27.399416 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:27.408574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-90074e36-0694-455b-8536-7e69657582f1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:27.409863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-90074e36-0694-455b-8536-7e69657582f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:27.428559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:27.429166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:27.429410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:27.429684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] PATH_INFO: `/v3/groups/d0af343cde1d408199e808b1ce14cca9` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:27.435873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] RBAC: Authorizing `identity:get_group(group_id=d0af343cde1d408199e808b1ce14cca9)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:27.437338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:27.439536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 190/380] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:27 2022] GET /identity/v3/groups/d0af343cde1d408199e808b1ce14cca9 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:27.448782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:27.560206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 191/381] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:27.579618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4407-f4f9-4268-b5c0-1e8ef53a90e3 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:27.617720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:27.618757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:27.619266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:27.619739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:27.620660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] RBAC: Adding query filter params (group.id=d0af343cde1d408199e808b1ce14cca9, role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=17429cdb686a41f6a3cf51eb7ac21844) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:27.621247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:27.622895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:27.629671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 191/382] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:27 2022] GET /identity/v3/role_assignments?group.id=d0af343cde1d408199e808b1ce14cca9&scope.project.id=17429cdb686a41f6a3cf51eb7ac21844&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:27.871851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90074e36-0694-455b-8536-7e69657582f1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:27.979493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:27.983134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90074e36-0694-455b-8536-7e69657582f1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:28.026384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:28.027395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.027916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.028432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.039979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:28.045769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:28.046667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:28.047473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:28.050171 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 192/383] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:28.056708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:28.103230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:28.166192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e98e-ee7c-4952-9704-ec69602041d9 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:28.203710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae191b61-96e4-4488-8f31-46991b8c7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:28.204677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191b61-96e4-4488-8f31-46991b8c7554 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.205177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191b61-96e4-4488-8f31-46991b8c7554 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.205664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191b61-96e4-4488-8f31-46991b8c7554 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.206529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae191b61-96e4-4488-8f31-46991b8c7554 None admin] RBAC: Adding query filter params (name=member) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:28.207029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae191b61-96e4-4488-8f31-46991b8c7554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:28.208724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae191b61-96e4-4488-8f31-46991b8c7554 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:28.218520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 192/384] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:28.224928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:28.235977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b35ee-678c-4dc4-938d-de2cd89859ea None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.236273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b35ee-678c-4dc4-938d-de2cd89859ea None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.236531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b35ee-678c-4dc4-938d-de2cd89859ea None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.238132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 193/385] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:28.244063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03dabd-fe04-45f3-ba45-972926a2f9b6 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.244063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03dabd-fe04-45f3-ba45-972926a2f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.244294 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03dabd-fe04-45f3-ba45-972926a2f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.277689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0b03dabd-fe04-45f3-ba45-972926a2f9b6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:28.278898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0b03dabd-fe04-45f3-ba45-972926a2f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:28.390800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c50bb-2387-4f71-ad72-5ebe805324de None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:28.403574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 194/386] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:28.443938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:28.444505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.444788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.445064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.446210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:28.447688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:28.449563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 193/387] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:28 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:28.454898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03dabd-fe04-45f3-ba45-972926a2f9b6 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:28.493978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:28.570488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03dabd-fe04-45f3-ba45-972926a2f9b6 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:28.608955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:28.609990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.610469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.610933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.612285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:28.614476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:28.616602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 195/388] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:28 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:28.628207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:28.682031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:28.707931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:28.802144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7b099-128c-4b67-97b7-769007c873a7 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:28.865041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:28.865699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.865969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.866233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd/groups/7617e364b4324b699251e261a36ea56e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.869342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] RBAC: Authorizing `identity:create_grant(project_id=7e48431aba38408c99d6522a99cbbdbd, group_id=7617e364b4324b699251e261a36ea56e, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:28.870792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:28.883877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d1c25-9fd7-483c-9006-75dc7c224ae7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:28.887606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:28.923451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:28.924079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:28.924353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:28.924620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:28.935037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:28.940011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:28.940917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:28.942611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 196/389] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:28.947460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:28.966984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 194/390] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 1 16:26:28 2022] PUT /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd/groups/7617e364b4324b699251e261a36ea56e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:29.084030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52249-3039-4d96-bcfd-0c0bca7b3292 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:29.130154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:29.130769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:29.131043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:29.131336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:29.132006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:29.132304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:29.133808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:29.147646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 197/391] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:29.153292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:29.258039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:29.271479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af0fd0-75e2-4dd1-88b1-53a8d86c177f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:29.312940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98e1cc-a88c-49c6-ab75-611ff59859be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:29.313571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e1cc-a88c-49c6-ab75-611ff59859be None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:29.313844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e1cc-a88c-49c6-ab75-611ff59859be None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:29.314111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e1cc-a88c-49c6-ab75-611ff59859be None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:29.315323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98e1cc-a88c-49c6-ab75-611ff59859be None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:29.317470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98e1cc-a88c-49c6-ab75-611ff59859be None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:29.319834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 195/392] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:29 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:29.325378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:29.354520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:29.369184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6869-71ac-43ea-98f2-d3f29595b8d8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:29.369464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6869-71ac-43ea-98f2-d3f29595b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:29.369771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6869-71ac-43ea-98f2-d3f29595b8d8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:29.371187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 196/393] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:29.377200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbe84-dc54-4a1d-b3cf-5dc09db87829 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:29.377740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbe84-dc54-4a1d-b3cf-5dc09db87829 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:29.378249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbe84-dc54-4a1d-b3cf-5dc09db87829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:29.402753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9d2fbe84-dc54-4a1d-b3cf-5dc09db87829 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:29.404645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9d2fbe84-dc54-4a1d-b3cf-5dc09db87829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:29.495208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481da92a-18d4-4cfe-b745-aaa7df552a26 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:29.524289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 197/394] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:29.546389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:29.547384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:29.547859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:29.548339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:29.549692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:29.551912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:29.554069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 198/395] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:29 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:29.559466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fbe84-dc54-4a1d-b3cf-5dc09db87829 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:29.667934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:29.688024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fbe84-dc54-4a1d-b3cf-5dc09db87829 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:29.734335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:29.735401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:29.735878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:29.736344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd/groups/7617e364b4324b699251e261a36ea56e/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:29.741436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e48431aba38408c99d6522a99cbbdbd, group_id=7617e364b4324b699251e261a36ea56e, role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:29.743100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:29.810113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 198/396] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 1 16:26:29 2022] PUT /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd/groups/7617e364b4324b699251e261a36ea56e/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:26:29.867894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:29.993992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:30.004809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aebcf-40ed-4a8b-9a62-59134d51fc72 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:30.042395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06537e6-9145-4eae-bbc8-769c0185e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:30.043073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06537e6-9145-4eae-bbc8-769c0185e9ac None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.043373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06537e6-9145-4eae-bbc8-769c0185e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.043643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06537e6-9145-4eae-bbc8-769c0185e9ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.056831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06537e6-9145-4eae-bbc8-769c0185e9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-d06537e6-9145-4eae-bbc8-769c0185e9ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:30.062942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:30.063908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:30.065351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 199/397] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:30.070333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:30.089453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e775a9-e958-46be-b40e-5d2d7628973a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.089762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e775a9-e958-46be-b40e-5d2d7628973a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.090003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e775a9-e958-46be-b40e-5d2d7628973a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.091667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 200/398] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:30.096704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e09c-67b4-4905-bf53-dbb6ea362c9b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.096990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e09c-67b4-4905-bf53-dbb6ea362c9b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.097266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e09c-67b4-4905-bf53-dbb6ea362c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.122193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-00f6e09c-67b4-4905-bf53-dbb6ea362c9b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:30.124367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-00f6e09c-67b4-4905-bf53-dbb6ea362c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:30.212598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11649-8b9f-409d-9280-ee13dd59f7b5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:30.252084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:30.253064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.253538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.254202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.255705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:30.256285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:30.257910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:30.268078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 199/399] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:30.274201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:30.288733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 201/400] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:30.291773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:30.387036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a88e-7952-49fc-a8da-b5b4ed72367f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:30.423352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33238212-ff08-40dc-8766-3fffa27c544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:30.424332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33238212-ff08-40dc-8766-3fffa27c544b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.424813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33238212-ff08-40dc-8766-3fffa27c544b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.425276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33238212-ff08-40dc-8766-3fffa27c544b None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.427179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33238212-ff08-40dc-8766-3fffa27c544b None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:30.428810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33238212-ff08-40dc-8766-3fffa27c544b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:30.430919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 200/401] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:30 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:30.436143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e09c-67b4-4905-bf53-dbb6ea362c9b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:30.503906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d7a7-f500-4fae-826e-bc84e356295c None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.504792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d7a7-f500-4fae-826e-bc84e356295c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.504980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d7a7-f500-4fae-826e-bc84e356295c None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.506641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 201/402] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:30.511614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549cd4-55f1-4f22-a87b-943f189e42b4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.511897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549cd4-55f1-4f22-a87b-943f189e42b4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.512173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549cd4-55f1-4f22-a87b-943f189e42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.540186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-cd549cd4-55f1-4f22-a87b-943f189e42b4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:30.541408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cd549cd4-55f1-4f22-a87b-943f189e42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:30.548583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:30.575284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e09c-67b4-4905-bf53-dbb6ea362c9b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:30.649574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 202/403] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:30.654744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:30.655443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.655729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.655998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.657139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:30.658583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:30.660516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 202/404] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:30 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:30.666121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd549cd4-55f1-4f22-a87b-943f189e42b4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:30.691552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:30.702635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:30.808217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b839fd8-7f9d-434a-977c-4a996457cc84 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:30.850791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:30.851477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.851830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.852103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.862404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:30.867838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:30.868707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:30.869498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 203/405] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:30.876149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:30.878727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd549cd4-55f1-4f22-a87b-943f189e42b4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:30.899478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:30.945336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:30.946268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:30.946695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:30.947092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c/groups/7617e364b4324b699251e261a36ea56e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:30.949479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] RBAC: Authorizing `identity:create_grant(project_id=48a104c3059e41fb968cc1394871836c, group_id=7617e364b4324b699251e261a36ea56e, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:30.951090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.011924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dca1b5-1c9a-484c-aeea-f42e1e7869b4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.044479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 203/406] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 1 16:26:30 2022] PUT /identity/v3/projects/48a104c3059e41fb968cc1394871836c/groups/7617e364b4324b699251e261a36ea56e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:26:31.045429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.057853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.058848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.059971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.060532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.061990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:31.062980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:31.064931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.077615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 204/407] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:31.083278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.128166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:31.173952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c460a-ede7-4276-9e06-fb92e9ccf3ad None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.190138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:31.211731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.212365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.212590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.212864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.225388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:31.231033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:31.234031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:31.235077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 204/408] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:31.239061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.239402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296cb56-857c-4143-a9e1-2dc70c1282ac None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.284504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.285929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.286800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.287262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.288548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:31.290994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.293532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 205/409] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:31 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:31.299599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.359511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2314-3120-4574-a067-4ea384bf404a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.390305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:31.400805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.404155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.404155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.404155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.404155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:31.404155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:31.405482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.411884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa13317-60d0-4671-81e9-c08ee8a6dbb6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.415539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 205/410] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:31.427248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.449868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.450498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.450771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.451040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.452199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:31.453771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.455611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 206/411] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:31 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:31.461379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.477907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:31.574072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a70ce3-198c-4c85-b184-ac1b17fce293 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.608794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.609452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.609730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.609999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c/groups/7617e364b4324b699251e261a36ea56e/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.612312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] RBAC: Authorizing `identity:create_grant(project_id=48a104c3059e41fb968cc1394871836c, group_id=7617e364b4324b699251e261a36ea56e, role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:31.614529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.674728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bac63b-f05e-42c5-a019-77c682f9d75a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.700784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 207/412] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 1 16:26:31 2022] PUT /identity/v3/projects/48a104c3059e41fb968cc1394871836c/groups/7617e364b4324b699251e261a36ea56e/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:31.714243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55fbee-df44-4723-82ab-f89a30c4a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.715620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55fbee-df44-4723-82ab-f89a30c4a968 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.716171 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55fbee-df44-4723-82ab-f89a30c4a968 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.716712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55fbee-df44-4723-82ab-f89a30c4a968 None admin] PATH_INFO: `/v3/groups/d0af343cde1d408199e808b1ce14cca9` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.718521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55fbee-df44-4723-82ab-f89a30c4a968 None admin] RBAC: Authorizing `identity:get_group(group_id=d0af343cde1d408199e808b1ce14cca9)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:31.720407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55fbee-df44-4723-82ab-f89a30c4a968 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.722587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 206/413] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:31 2022] GET /identity/v3/groups/d0af343cde1d408199e808b1ce14cca9 => generated 229 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:31.728380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:31.847947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:31.884402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8267-de49-44fd-8a1d-fc247abffb50 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.884740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8267-de49-44fd-8a1d-fc247abffb50 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.884948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8267-de49-44fd-8a1d-fc247abffb50 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.886351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 207/414] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:31.892219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b3f8-18ce-4553-8da4-f52a00d790ed None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.892498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b3f8-18ce-4553-8da4-f52a00d790ed None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.892767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b3f8-18ce-4553-8da4-f52a00d790ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.893652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ca243-b830-48cb-bcb0-f74ca9f8f05a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:31.915222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d051b3f8-18ce-4553-8da4-f52a00d790ed None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:31.916814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d051b3f8-18ce-4553-8da4-f52a00d790ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:31.939975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:31.940969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.942000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.942932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] PATH_INFO: `/v3/projects/17429cdb686a41f6a3cf51eb7ac21844` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.944590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] RBAC: Authorizing `identity:get_project(project_id=17429cdb686a41f6a3cf51eb7ac21844)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:31.947214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:31.949564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 208/415] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:31 2022] GET /identity/v3/projects/17429cdb686a41f6a3cf51eb7ac21844 => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:31.955609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:32.000441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:32.032195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 208/416] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:32.060011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184beca-9779-46e3-a384-4415a3ea2ac2 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:32.060342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184beca-9779-46e3-a384-4415a3ea2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:32.060566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184beca-9779-46e3-a384-4415a3ea2ac2 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.062040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 209/417] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:32.067535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f5aa8-441c-420e-996a-89f99ba6790b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:32.067812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f5aa8-441c-420e-996a-89f99ba6790b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:32.068088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f5aa8-441c-420e-996a-89f99ba6790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.087774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153e659-4089-49d8-9116-469c16021d9f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:32.088426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-db3f5aa8-441c-420e-996a-89f99ba6790b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:32.089713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-db3f5aa8-441c-420e-996a-89f99ba6790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:32.132536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:32.135003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:32.135851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:32.136696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] PATH_INFO: `/v3/projects/17429cdb686a41f6a3cf51eb7ac21844/groups/d0af343cde1d408199e808b1ce14cca9/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.138924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=17429cdb686a41f6a3cf51eb7ac21844, group_id=d0af343cde1d408199e808b1ce14cca9, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:32.140587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:32.147452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:32.183855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 210/418] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:32.215508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 209/419] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 1 16:26:31 2022] PUT /identity/v3/projects/17429cdb686a41f6a3cf51eb7ac21844/groups/d0af343cde1d408199e808b1ce14cca9/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:26:32.348341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f5aa8-441c-420e-996a-89f99ba6790b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:32.466516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f5aa8-441c-420e-996a-89f99ba6790b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:32.484362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:32.505191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:32.505842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:32.506151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:32.506423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.518090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:32.522640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:32.523964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:32.524831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:32.525622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:32.529584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 211/420] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:32.537567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:32.705626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281cb7b-8d84-475b-9d4c-66f43198db7a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:32.739417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd0dfc-f45b-4768-871c-8b2a1b2b56d7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:32.745478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:32.746085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:32.746365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:32.746631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.747328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:32.747632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:32.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:32.765685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 212/421] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:32.771175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:32.808853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:32.809487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:32.809762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:32.810033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.832754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:32.844982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:32.845919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:32.846733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 210/422] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:32.848781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:32.854732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:32.958925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:32.960308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942fc8-44e1-42ed-9881-8a188263c1ff None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:33.032820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf969-735d-4032-a79e-7bf0d072aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:33.033432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf969-735d-4032-a79e-7bf0d072aeef None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.033710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf969-735d-4032-a79e-7bf0d072aeef None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.033980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf969-735d-4032-a79e-7bf0d072aeef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.036721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ee14c-5f9a-45ae-9036-c9c80b36d0c2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:33.094842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:33.096572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.097052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.098172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.099049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:33.099734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:33.103072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:33.117857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 211/423] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:33.123828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:33.231783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a56276-a498-4d30-91ce-18bc2cf1a6e5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:33.248000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf969-735d-4032-a79e-7bf0d072aeef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:33.249586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf969-735d-4032-a79e-7bf0d072aeef None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:33.263561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:33.272556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd5a27-09ca-4642-9448-041bd617bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:33.279994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd5a27-09ca-4642-9448-041bd617bedd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.279994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd5a27-09ca-4642-9448-041bd617bedd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.279994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd5a27-09ca-4642-9448-041bd617bedd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.357039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd5a27-09ca-4642-9448-041bd617bedd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:33.358856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd5a27-09ca-4642-9448-041bd617bedd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:33.367499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:33.469687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 213/424] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:26:33.471046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be78f-2b44-4f5a-be6a-6a3b5163febf None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.471356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be78f-2b44-4f5a-be6a-6a3b5163febf None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.471631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be78f-2b44-4f5a-be6a-6a3b5163febf None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.477807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 214/425] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:33.478603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be78f-2b44-4f5a-be6a-6a3b5163febf None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:33.531279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 212/426] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:26:33.533037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79417b-6700-41a5-9896-0eefb5c489b8 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.533538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79417b-6700-41a5-9896-0eefb5c489b8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.534011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79417b-6700-41a5-9896-0eefb5c489b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.557116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-da79417b-6700-41a5-9896-0eefb5c489b8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:33.559548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-da79417b-6700-41a5-9896-0eefb5c489b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:33.577576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:33.604304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be78f-2b44-4f5a-be6a-6a3b5163febf None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:33.654771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:33.655445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.655722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.655996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.657454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:33.658912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:33.660778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 215/427] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:33 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:33.661626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:33.661838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 213/428] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:33.666883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79417b-6700-41a5-9896-0eefb5c489b8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:33.679013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:33.811987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37ca90-3b0a-4a78-b9a5-a87d4134a3be None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:33.857530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:33.858161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.858435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.858703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] PATH_INFO: `/v3/projects/7e48431aba38408c99d6522a99cbbdbd` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.862999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79417b-6700-41a5-9896-0eefb5c489b8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:33.864936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] RBAC: Authorizing `identity:get_project(project_id=7e48431aba38408c99d6522a99cbbdbd)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:33.866373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:33.868050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 216/429] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:33 2022] GET /identity/v3/projects/7e48431aba38408c99d6522a99cbbdbd => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:33.875126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:33.943677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be048d1d-681d-45aa-b318-e0eb9a4927ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:33.944317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048d1d-681d-45aa-b318-e0eb9a4927ed None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.944615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048d1d-681d-45aa-b318-e0eb9a4927ed None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.944864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048d1d-681d-45aa-b318-e0eb9a4927ed None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.946331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be048d1d-681d-45aa-b318-e0eb9a4927ed None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:33.947797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be048d1d-681d-45aa-b318-e0eb9a4927ed None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:33.949502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 214/430] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:33 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:33.950461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec2c1-16d6-419e-9177-7a6ad333ed69 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:33.950739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec2c1-16d6-419e-9177-7a6ad333ed69 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:33.951012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec2c1-16d6-419e-9177-7a6ad333ed69 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:33.955988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 215/431] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:33.955988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fec2c1-16d6-419e-9177-7a6ad333ed69 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:33.970238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:33.979598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.005333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cca856-9922-4b3b-84dc-2cb3ba6cdbdc None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.040693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.041318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.041592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.041903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.043182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:34.044629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:34.046192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 217/432] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:33 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:34.046943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.065678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fec2c1-16d6-419e-9177-7a6ad333ed69 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.100804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b81b7-6a4e-4234-a4d0-42023c85be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.101430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b81b7-6a4e-4234-a4d0-42023c85be18 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.101702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b81b7-6a4e-4234-a4d0-42023c85be18 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.101970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b81b7-6a4e-4234-a4d0-42023c85be18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.112531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b81b7-6a4e-4234-a4d0-42023c85be18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-495b81b7-6a4e-4234-a4d0-42023c85be18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:34.117628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:34.118540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 216/433] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:34.124235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d2b3-10e6-4923-ba07-83b295bf4cf4 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.124974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d2b3-10e6-4923-ba07-83b295bf4cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.124974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d2b3-10e6-4923-ba07-83b295bf4cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.139042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1025d2b3-10e6-4923-ba07-83b295bf4cf4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:34.140255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1025d2b3-10e6-4923-ba07-83b295bf4cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:34.177155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ed81a-6c2e-4a85-8f27-f0a54a0a3586 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.212361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.212969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.213253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.213564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.214246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=7e48431aba38408c99d6522a99cbbdbd) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:34.214557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:34.219322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 217/434] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:34.219474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:34.219564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d2b3-10e6-4923-ba07-83b295bf4cf4 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.221560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.239221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 218/435] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:34.239221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.241749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.351259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a63bc1-384c-4902-bda8-455027aa396c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.390959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.391885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.392228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.392574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.393325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:34.393883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:34.396334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:34.406900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 219/436] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:34.417886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.427304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d2b3-10e6-4923-ba07-83b295bf4cf4 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.499687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.500621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.501066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.501604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.502341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=7e48431aba38408c99d6522a99cbbdbd) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:34.502647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:34.504207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:34.511439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 218/437] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=7e48431aba38408c99d6522a99cbbdbd&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 611 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:34.512291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.527826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.575246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d35ea-caae-4cfe-8017-dc0e9bdc10bd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.608147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.629428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00834de-103f-42bd-b98a-6fdf0a5b0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.630339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00834de-103f-42bd-b98a-6fdf0a5b0f7f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.630754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00834de-103f-42bd-b98a-6fdf0a5b0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.631206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00834de-103f-42bd-b98a-6fdf0a5b0f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.656560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c969a6-d162-410b-9db7-33798b875711 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.716998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f7e1-df2d-40eb-a0b6-169cdbdf33d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.717634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f7e1-df2d-40eb-a0b6-169cdbdf33d6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.717908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f7e1-df2d-40eb-a0b6-169cdbdf33d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.718174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f7e1-df2d-40eb-a0b6-169cdbdf33d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.727426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00834de-103f-42bd-b98a-6fdf0a5b0f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:34.729057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00834de-103f-42bd-b98a-6fdf0a5b0f7f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:34.738290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f7e1-df2d-40eb-a0b6-169cdbdf33d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-10a2f7e1-df2d-40eb-a0b6-169cdbdf33d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:34.745673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:34.746580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:34.747389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:34.748573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 219/438] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:34.749398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6986-d002-446e-ba7a-ddaa026897d8 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.749629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6986-d002-446e-ba7a-ddaa026897d8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.750731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6986-d002-446e-ba7a-ddaa026897d8 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.755496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 220/439] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:34.756834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6986-d002-446e-ba7a-ddaa026897d8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.812675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.850592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 220/440] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:26:34.851727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1979-831f-4444-a486-d6563dd2a153 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.852011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1979-831f-4444-a486-d6563dd2a153 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.852288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1979-831f-4444-a486-d6563dd2a153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.872367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2eed1979-831f-4444-a486-d6563dd2a153 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:34.874066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2eed1979-831f-4444-a486-d6563dd2a153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:34.880626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6986-d002-446e-ba7a-ddaa026897d8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:34.911437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:34.919864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:34.923113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:34.923113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:34.923113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:34.923113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:34.923113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:34.925378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:34.933384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 221/441] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:34.934196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:34.955586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 221/442] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:34.956517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1979-831f-4444-a486-d6563dd2a153 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.064410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836999e-c114-488f-902d-cfea59ac6a34 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.068724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.072977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1979-831f-4444-a486-d6563dd2a153 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.099435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.100069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.100394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.100661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.101787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.103255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.104860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 222/443] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:35.110135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.112388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.113257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.113687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.113954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.172219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.188697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.190183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.225198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7382d-182c-424c-ac14-52168a7c487a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.261256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.261884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.262186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.262453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.263599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.265027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.266808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 223/444] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:35.267364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.288703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.293521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 222/445] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:35.294398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.371918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0de879-9908-485b-8ab9-4f56d971ea9f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.392399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c829da6-b5b5-42c2-8656-737e40c3051c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.397504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.405850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.406472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.413286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.413286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.417620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:35.422483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:35.423663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:35.424597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 224/446] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:35.427124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.427425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.428029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.428286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.428556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.429334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7, scope.project.id=48a104c3059e41fb968cc1394871836c) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:35.429641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.431067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.436883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 223/447] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:35.437655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.505785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.544553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554c084-9b7b-4951-9082-541a0e96b997 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.549217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6e005-c047-443a-ad10-c935fd595ede None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.582722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.583447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.583725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.583998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] PATH_INFO: `/v3/projects/48a104c3059e41fb968cc1394871836c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.585753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] RBAC: Authorizing `identity:get_project(project_id=48a104c3059e41fb968cc1394871836c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.587249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.589624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 225/448] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/projects/48a104c3059e41fb968cc1394871836c => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:35.589869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.590636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.590911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.591227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.591895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:35.592198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.593566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.594456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.604321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 224/449] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:35.608661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.659370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.708432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2fa7-2008-49c1-a33d-befa788e08fe None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.731148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b88d1-1caf-45e6-93f2-60ff749540af None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.749214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.749857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.750489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.750489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] PATH_INFO: `/v3/groups/7617e364b4324b699251e261a36ea56e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.751554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] RBAC: Authorizing `identity:get_group(group_id=7617e364b4324b699251e261a36ea56e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.752983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.754776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 226/450] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/groups/7617e364b4324b699251e261a36ea56e => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:35.759828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.760775 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:35.769784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.770394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.770670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.770941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.842204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.843700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.866752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673226-fd88-4585-b28c-05a020e29950 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:35.889036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:35.901675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:35.902273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:35.902553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:35.902824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:35.903579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] RBAC: Adding query filter params (group.id=7617e364b4324b699251e261a36ea56e, role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=48a104c3059e41fb968cc1394871836c) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:35.903886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:35.905287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:35.911455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 227/451] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/role_assignments?group.id=7617e364b4324b699251e261a36ea56e&scope.project.id=48a104c3059e41fb968cc1394871836c&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:35.946935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 225/452] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:26:35.952923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:36.057007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec73b4-f797-43be-96e5-4a2f5adb0bf6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:36.092415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:36.093037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:36.093317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:36.093583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] PATH_INFO: `/v3/projects/17429cdb686a41f6a3cf51eb7ac21844` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:36.094707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] RBAC: Authorizing `identity:get_project(project_id=17429cdb686a41f6a3cf51eb7ac21844)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:36.096172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:36.097824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 228/453] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:26:35 2022] GET /identity/v3/projects/17429cdb686a41f6a3cf51eb7ac21844 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:36.103400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:36.128671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:36.206744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ae14-3f6f-4068-88d3-6a47c78e6f54 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:36.242553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45904bb4-0743-45c5-969b-21e8e132a8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:36.243253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45904bb4-0743-45c5-969b-21e8e132a8ae None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:36.243528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45904bb4-0743-45c5-969b-21e8e132a8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:36.243798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45904bb4-0743-45c5-969b-21e8e132a8ae None admin] PATH_INFO: `/v3/groups/d0af343cde1d408199e808b1ce14cca9` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:36.244907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45904bb4-0743-45c5-969b-21e8e132a8ae None admin] RBAC: Authorizing `identity:get_group(group_id=d0af343cde1d408199e808b1ce14cca9)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:36.246337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45904bb4-0743-45c5-969b-21e8e132a8ae None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:36.247946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 226/454] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 1 16:26:36 2022] GET /identity/v3/groups/d0af343cde1d408199e808b1ce14cca9 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:36.254580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:36.310955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:36.352863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7906ed7-a0df-4f4a-96dc-590554ec5094 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:36.386131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18d410-8f43-45bb-8e24-46ce8bc31f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:36.386723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18d410-8f43-45bb-8e24-46ce8bc31f35 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:36.387002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18d410-8f43-45bb-8e24-46ce8bc31f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:36.387318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18d410-8f43-45bb-8e24-46ce8bc31f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:36.388034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18d410-8f43-45bb-8e24-46ce8bc31f35 None admin] RBAC: Adding query filter params (group.id=d0af343cde1d408199e808b1ce14cca9, role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=17429cdb686a41f6a3cf51eb7ac21844) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:36.388340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18d410-8f43-45bb-8e24-46ce8bc31f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:36.389771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18d410-8f43-45bb-8e24-46ce8bc31f35 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:36.395306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 229/455] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 1 16:26:36 2022] GET /identity/v3/role_assignments?group.id=d0af343cde1d408199e808b1ce14cca9&scope.project.id=17429cdb686a41f6a3cf51eb7ac21844&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:38.669991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de675ec3-545f-44e7-b1e4-87435fd25c7e None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:38.670481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de675ec3-545f-44e7-b1e4-87435fd25c7e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:38.670554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de675ec3-545f-44e7-b1e4-87435fd25c7e None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:38.672119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 227/456] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:38.680956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78190c6-fc35-4f49-96d2-fd7475929c44 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:38.681752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78190c6-fc35-4f49-96d2-fd7475929c44 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:38.682220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78190c6-fc35-4f49-96d2-fd7475929c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:38.708622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c78190c6-fc35-4f49-96d2-fd7475929c44 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:38.710214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c78190c6-fc35-4f49-96d2-fd7475929c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:38.793677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 230/457] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:38.947611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2817c1-cb80-4037-87c9-09c042caa7ee None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:38.948228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2817c1-cb80-4037-87c9-09c042caa7ee None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:38.948698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2817c1-cb80-4037-87c9-09c042caa7ee None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:38.950477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 228/458] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:38.955495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4927-766f-40db-a4dc-edcc6015dd41 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:38.956042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4927-766f-40db-a4dc-edcc6015dd41 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:38.956513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4927-766f-40db-a4dc-edcc6015dd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:38.984750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-657e4927-766f-40db-a4dc-edcc6015dd41 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:38.986252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-657e4927-766f-40db-a4dc-edcc6015dd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:39.044121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:39.074000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 231/459] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:39.081641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2817c1-cb80-4037-87c9-09c042caa7ee None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:39.200907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:39.214093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2817c1-cb80-4037-87c9-09c042caa7ee None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:39.267470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f998a7-b37d-43cc-bcdf-d9b56b254c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:39.268119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f998a7-b37d-43cc-bcdf-d9b56b254c55 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.268396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f998a7-b37d-43cc-bcdf-d9b56b254c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.268665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f998a7-b37d-43cc-bcdf-d9b56b254c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.288911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f998a7-b37d-43cc-bcdf-d9b56b254c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:39.290388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f998a7-b37d-43cc-bcdf-d9b56b254c55 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-b6f998a7-b37d-43cc-bcdf-d9b56b254c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:39.309403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:39.310329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:39.311223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:39.311223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:39.311223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:39.311223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 229/460] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:39.316723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e4927-766f-40db-a4dc-edcc6015dd41 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:39.347603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753d46-3b31-4dbf-a78e-fa4df3c914a3 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.347899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753d46-3b31-4dbf-a78e-fa4df3c914a3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.348125 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753d46-3b31-4dbf-a78e-fa4df3c914a3 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.349744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 230/461] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:39.354239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1fab-0af8-4890-be72-8a594d01cec5 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.354516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1fab-0af8-4890-be72-8a594d01cec5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.354787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1fab-0af8-4890-be72-8a594d01cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.384792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-934a1fab-0af8-4890-be72-8a594d01cec5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:39.386820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-934a1fab-0af8-4890-be72-8a594d01cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:39.445343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e4927-766f-40db-a4dc-edcc6015dd41 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:39.461421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 231/462] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:39.462487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a1fab-0af8-4890-be72-8a594d01cec5 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:39.481556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:39.482381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.482802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.483267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.484054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:39.484511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:39.486024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:39.498500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 232/463] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:39.505940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:39.543978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:39.564764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:39.569301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a1fab-0af8-4890-be72-8a594d01cec5 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:39.604831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:39.605811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.606321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.606789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.617870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:39.619676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:39.635466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:39.636393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:39.637233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:39.637233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:39.637233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:39.637696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749011d-0355-40d5-a221-447230ce5184 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:39.643355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 232/464] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:39.645666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:39.686873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f34c0a-d45f-4182-8ce4-316c50623389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:39.687509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34c0a-d45f-4182-8ce4-316c50623389 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.687992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34c0a-d45f-4182-8ce4-316c50623389 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.688529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34c0a-d45f-4182-8ce4-316c50623389 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.689340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f34c0a-d45f-4182-8ce4-316c50623389 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:39.691089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f34c0a-d45f-4182-8ce4-316c50623389 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:39.751810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838d4d0-81a7-430f-b5b8-c0b794c69f56 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:39.776886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 233/465] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:39 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:39.776886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8d4f-9db7-49db-bc00-b5a612b3fa04 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.776886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8d4f-9db7-49db-bc00-b5a612b3fa04 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.776886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8d4f-9db7-49db-bc00-b5a612b3fa04 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.776886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 234/466] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:39.781907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413aa34-9a19-4f0f-9261-d4b87c32f776 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.782198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413aa34-9a19-4f0f-9261-d4b87c32f776 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.782462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413aa34-9a19-4f0f-9261-d4b87c32f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.809147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:39.822243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:39.822859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:39.823131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:39.823421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:39.824079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:39.824378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:39.825698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f413aa34-9a19-4f0f-9261-d4b87c32f776 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:39.826904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f413aa34-9a19-4f0f-9261-d4b87c32f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:39.829943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:39.857868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 233/467] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:39.858972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:39.914002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 235/468] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:39.915792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413aa34-9a19-4f0f-9261-d4b87c32f776 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:39.958523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:40.020752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715d3a1-463d-4178-b50e-c20d7597dc57 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.062541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.063546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.064026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.064495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.064901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413aa34-9a19-4f0f-9261-d4b87c32f776 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.077033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.080110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:40.097806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:40.098755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:40.099977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:40.099977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:40.099977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:40.101904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 234/469] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:40.107773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:40.110183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310c87-faf7-4a27-afbe-2b13b4bac775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.111101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310c87-faf7-4a27-afbe-2b13b4bac775 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.111410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310c87-faf7-4a27-afbe-2b13b4bac775 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.111671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310c87-faf7-4a27-afbe-2b13b4bac775 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.112318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64310c87-faf7-4a27-afbe-2b13b4bac775 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.114810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64310c87-faf7-4a27-afbe-2b13b4bac775 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.157469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:40.221940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 236/470] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:39 2022] POST /identity/v3/users => generated 248 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:40.223292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e98fc-2066-4e82-b661-7dde4803ceb0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.223942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150a55-313c-4520-ab99-f18f6f4df7fa None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.224480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150a55-313c-4520-ab99-f18f6f4df7fa None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.225003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150a55-313c-4520-ab99-f18f6f4df7fa None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.226669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 237/471] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:40.231834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9150a55-313c-4520-ab99-f18f6f4df7fa None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:40.274284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a9b5-547b-48b3-a54c-db3649f8add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.275349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a9b5-547b-48b3-a54c-db3649f8add2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.275828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a9b5-547b-48b3-a54c-db3649f8add2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.276294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a9b5-547b-48b3-a54c-db3649f8add2 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.277406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01a9b5-547b-48b3-a54c-db3649f8add2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:40.277927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01a9b5-547b-48b3-a54c-db3649f8add2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.279645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01a9b5-547b-48b3-a54c-db3649f8add2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.294370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 235/472] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:40.296047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaf9a3-1b3c-4244-9368-4fd6e9cc66ad None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.296540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaf9a3-1b3c-4244-9368-4fd6e9cc66ad None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.297005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaf9a3-1b3c-4244-9368-4fd6e9cc66ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.317163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-24eaf9a3-1b3c-4244-9368-4fd6e9cc66ad None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:40.318772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-24eaf9a3-1b3c-4244-9368-4fd6e9cc66ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:40.344913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:40.369326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9150a55-313c-4520-ab99-f18f6f4df7fa None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.401204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 236/473] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:40.402344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaf9a3-1b3c-4244-9368-4fd6e9cc66ad None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:40.412105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.412105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.412330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.412434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.424151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.426201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.433189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:40.444879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:40.445818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:40.446687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:40.446687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:40.446687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:40.446687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 238/474] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:40.451661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:40.526714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaf9a3-1b3c-4244-9368-4fd6e9cc66ad None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.567863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.568821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.569345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.569803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.570702 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.573176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.594267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4afce-4133-4024-a656-a700a11e9b9a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.627136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:40.633580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.634191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.634538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.634721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.635411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:40.635715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.637084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.651247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 239/475] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:40.659207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:40.680530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 237/476] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:40 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:40.726904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:40.811734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b048-95b9-42c8-8d8a-0adf31bd34e8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.851805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.852799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.853355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.853830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.854792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.856538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.874919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:40.894373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55afa7-853b-4aa4-8c23-d16a2fa2ebc6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:40.929057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:40.929664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.929939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.930270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.930939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:40.932456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:40.947936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 240/477] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:40 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:26:40.970241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.sql.core [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:26:40.970241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:26:40.970241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [parameters: {'id': '31e4cf3e1dd842258fbfc93a75574b86', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:26:40.970241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81831) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result.read() Sep 01 16:26:40.986681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:26:40.987696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application yield resource Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise self.value Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application session.commit() Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:26:40.988617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:26:40.989501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:26:40.990421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result.read() Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:26:40.992252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [parameters: {'id': '31e4cf3e1dd842258fbfc93a75574b86', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:40.994276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:26:40.995999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:40.997033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 238/478] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 1 16:26:40 2022] POST /identity/v3/roles => generated 144 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:41.003001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:41.064082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:41.123316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5354f3-c94f-4b35-9c41-a7c1add39e29 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:41.159626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eae29b-8594-4a12-811f-d97a10d3a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:41.160327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eae29b-8594-4a12-811f-d97a10d3a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:41.160608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eae29b-8594-4a12-811f-d97a10d3a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:41.160882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eae29b-8594-4a12-811f-d97a10d3a1d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:41.171200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eae29b-8594-4a12-811f-d97a10d3a1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-87eae29b-8594-4a12-811f-d97a10d3a1d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:41.177228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:41.178068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:41.178841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 241/479] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:41.186017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:41.298999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f37ac-15fc-4fcb-92f7-54bfb6ef49ba None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:41.334397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429984d-e8c0-4cc9-8bfb-fdc41f60fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:41.334918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429984d-e8c0-4cc9-8bfb-fdc41f60fc57 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:41.335216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429984d-e8c0-4cc9-8bfb-fdc41f60fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:41.335492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429984d-e8c0-4cc9-8bfb-fdc41f60fc57 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:41.336150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429984d-e8c0-4cc9-8bfb-fdc41f60fc57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:41.336448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429984d-e8c0-4cc9-8bfb-fdc41f60fc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:41.337987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429984d-e8c0-4cc9-8bfb-fdc41f60fc57 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:41.347007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 239/480] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:42.102537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf196b-1857-4bc9-b97f-f73ac3cdccf6 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:42.103060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf196b-1857-4bc9-b97f-f73ac3cdccf6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:42.103187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf196b-1857-4bc9-b97f-f73ac3cdccf6 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:42.104854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 242/481] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:42.109997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2aac-9b38-4711-b9fb-c387548c5b0f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:42.110405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2aac-9b38-4711-b9fb-c387548c5b0f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:42.110594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c2aac-9b38-4711-b9fb-c387548c5b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:42.135217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-904c2aac-9b38-4711-b9fb-c387548c5b0f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:42.136439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-904c2aac-9b38-4711-b9fb-c387548c5b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:42.139570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:42.222737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 240/482] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:42.674656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e1de-c0e4-4a67-ab60-e780d693ae9a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:42.674964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e1de-c0e4-4a67-ab60-e780d693ae9a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:42.675738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e1de-c0e4-4a67-ab60-e780d693ae9a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:42.677443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 243/483] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:42.683762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c2aac-9b38-4711-b9fb-c387548c5b0f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:42.691964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c7c8-ae7c-4e6b-833c-24081bfc099c None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:42.692242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c7c8-ae7c-4e6b-833c-24081bfc099c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:42.692510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c7c8-ae7c-4e6b-833c-24081bfc099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:42.711467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8578c7c8-ae7c-4e6b-833c-24081bfc099c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:42.712877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8578c7c8-ae7c-4e6b-833c-24081bfc099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:42.819554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 244/484] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:26:42.851873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c2aac-9b38-4711-b9fb-c387548c5b0f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:42.887571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:42.888200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:42.888472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:42.888740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:42.897543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:42.900705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:42.906080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:42.906962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:42.907937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 241/485] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:42.916277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c7c8-ae7c-4e6b-833c-24081bfc099c None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:42.973453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:43.063772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c7c8-ae7c-4e6b-833c-24081bfc099c None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:43.103256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.104018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.104200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.104472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.105139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:43.105438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:43.106790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:43.122351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 245/486] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:43.127590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.177998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.244256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ebb9b-cd19-4b77-965c-7d2ab7fcaafc None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:43.309302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad45530-57c6-4c3e-8eb7-143a0f830d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.309926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45530-57c6-4c3e-8eb7-143a0f830d34 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.310203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45530-57c6-4c3e-8eb7-143a0f830d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.310472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45530-57c6-4c3e-8eb7-143a0f830d34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.321277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad45530-57c6-4c3e-8eb7-143a0f830d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:43.322754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad45530-57c6-4c3e-8eb7-143a0f830d34 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6ad45530-57c6-4c3e-8eb7-143a0f830d34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:43.338131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:43.339077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:43.340352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:43.340352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:43.340352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:43.340352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 242/487] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:43.340742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d499-e083-4bdc-ad6a-858d26b53ecd None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.341022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d499-e083-4bdc-ad6a-858d26b53ecd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.341328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d499-e083-4bdc-ad6a-858d26b53ecd None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.347462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 243/488] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:43.351452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d499-e083-4bdc-ad6a-858d26b53ecd None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.355091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:43.359095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41a288-9b82-42be-97ad-48348b44b22b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:43.397819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0cc68-138c-4f6a-8a19-9f0678c819d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.398924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cc68-138c-4f6a-8a19-9f0678c819d0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.399405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cc68-138c-4f6a-8a19-9f0678c819d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.399819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cc68-138c-4f6a-8a19-9f0678c819d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.408155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:43.412853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0cc68-138c-4f6a-8a19-9f0678c819d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6ad0cc68-138c-4f6a-8a19-9f0678c819d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:43.418507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:43.419603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:43.420552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:43.422623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 246/489] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:43.423998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd36e4-7ad9-4189-9af2-3d75ada9ac03 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.424440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd36e4-7ad9-4189-9af2-3d75ada9ac03 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.424863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd36e4-7ad9-4189-9af2-3d75ada9ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.446027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-90cd36e4-7ad9-4189-9af2-3d75ada9ac03 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:43.447491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-90cd36e4-7ad9-4189-9af2-3d75ada9ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:43.459895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d499-e083-4bdc-ad6a-858d26b53ecd None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:43.496530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.497039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.497317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.497638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.498687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:43.498805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:43.500221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:43.518043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 244/490] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:43.519588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.531352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 247/491] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:43.532561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd36e4-7ad9-4189-9af2-3d75ada9ac03 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.637695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1d1d-0336-46dd-9def-9c0822c2342b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:43.661277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:43.690050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bdac3-e11c-40aa-82a5-6445a1aaba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.691589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bdac3-e11c-40aa-82a5-6445a1aaba84 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.692040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bdac3-e11c-40aa-82a5-6445a1aaba84 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.692448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bdac3-e11c-40aa-82a5-6445a1aaba84 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:43.694725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bdac3-e11c-40aa-82a5-6445a1aaba84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:43.695197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bdac3-e11c-40aa-82a5-6445a1aaba84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:43.697535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bdac3-e11c-40aa-82a5-6445a1aaba84 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:43.702969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd36e4-7ad9-4189-9af2-3d75ada9ac03 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:43.713189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 245/492] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:43.713189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad109e1-31fd-43cd-92cf-6b790c682171 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.713189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad109e1-31fd-43cd-92cf-6b790c682171 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.713189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad109e1-31fd-43cd-92cf-6b790c682171 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.713189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 246/493] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:43.717240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad109e1-31fd-43cd-92cf-6b790c682171 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.753289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0cb23-4be1-4828-9dff-607f733e7d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.754350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cb23-4be1-4828-9dff-607f733e7d2e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.754831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cb23-4be1-4828-9dff-607f733e7d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.755334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cb23-4be1-4828-9dff-607f733e7d2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.763087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0cb23-4be1-4828-9dff-607f733e7d2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:43.764964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0cb23-4be1-4828-9dff-607f733e7d2e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-4eb0cb23-4be1-4828-9dff-607f733e7d2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:43.779485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:43.780427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:26:43.781323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:43.784118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 248/494] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:43.786149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e1d0-b5cd-40bc-99d8-daaef95608c2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.786641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e1d0-b5cd-40bc-99d8-daaef95608c2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.787100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e1d0-b5cd-40bc-99d8-daaef95608c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.806485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-46a9e1d0-b5cd-40bc-99d8-daaef95608c2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:43.808171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-46a9e1d0-b5cd-40bc-99d8-daaef95608c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:43.830054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad109e1-31fd-43cd-92cf-6b790c682171 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:43.865173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:43.865796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:43.866072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:43.866353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:43.876850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:43.878369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:43.891180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 249/495] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:43.891180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e1d0-b5cd-40bc-99d8-daaef95608c2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:43.892660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:43.893746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:43.894824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:43.894824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:43.894824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:43.897658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 247/496] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:43.898611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:43.927086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:43.993521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.001143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812f87-5e48-4038-8835-fbdea8e182f3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.012887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e1d0-b5cd-40bc-99d8-daaef95608c2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.036836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.037454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.037725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.037991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.047519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b6710-51e2-4ff3-bd13-c642a037e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.047962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:44.048083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6710-51e2-4ff3-bd13-c642a037e17e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.048362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6710-51e2-4ff3-bd13-c642a037e17e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.048629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6710-51e2-4ff3-bd13-c642a037e17e None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.049347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b6710-51e2-4ff3-bd13-c642a037e17e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:44.049647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b6710-51e2-4ff3-bd13-c642a037e17e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.051212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b6710-51e2-4ff3-bd13-c642a037e17e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:44.052805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:44.053655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:44.054555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 248/497] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:44.055781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.098170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 250/498] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:26:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:44.098170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fa015-f2bd-40c5-b2cb-333bbf630e44 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.098170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fa015-f2bd-40c5-b2cb-333bbf630e44 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.098170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fa015-f2bd-40c5-b2cb-333bbf630e44 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.098170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 251/499] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:44.098170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fa015-f2bd-40c5-b2cb-333bbf630e44 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.146615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.162167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d85b4-cf8c-4cbc-8779-70653da14bc6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.196982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.197589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.197868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.198137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.198836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:44.199144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.200549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.200957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fa015-f2bd-40c5-b2cb-333bbf630e44 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.211663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 249/500] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:44.212464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.235003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bc8a7-f497-4f54-bee3-40697c09f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.236956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc8a7-f497-4f54-bee3-40697c09f553 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.236956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc8a7-f497-4f54-bee3-40697c09f553 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.236956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc8a7-f497-4f54-bee3-40697c09f553 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.236956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bc8a7-f497-4f54-bee3-40697c09f553 None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:44.237282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bc8a7-f497-4f54-bee3-40697c09f553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.238930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bc8a7-f497-4f54-bee3-40697c09f553 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.250159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.250159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 252/501] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:44.250159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e399f-cb18-4611-8306-3a571e9b18c4 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.250159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e399f-cb18-4611-8306-3a571e9b18c4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.250159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e399f-cb18-4611-8306-3a571e9b18c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.267554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-275e399f-cb18-4611-8306-3a571e9b18c4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:44.268770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-275e399f-cb18-4611-8306-3a571e9b18c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:44.320033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7dc9-0bb8-4274-8dc9-a6a1ac7b14c1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.335247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 253/502] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:44.336077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e399f-cb18-4611-8306-3a571e9b18c4 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.363589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.364212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.364496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.364769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.381418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.437787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.438546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e399f-cb18-4611-8306-3a571e9b18c4 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.439286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.468137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.473853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.474476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.474744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.475022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.486764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:44.492190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:44.493050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:44.493819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 254/503] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:44.494464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.551467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 250/504] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:44.551467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.594466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.610183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582cf0-b787-4348-aaa6-6c8d5ee19bbd None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.646211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.647099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.647414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.647680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.649185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc11e3-b1cd-4571-9316-f000a4ff5ae9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.657096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.658551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:44.669876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:44.670943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 255/505] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:44.671892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.686596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.687250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.687536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.687807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.698549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.700073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:44.714302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:44.715406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:44.716261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:44.716261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:44.716261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:44.716261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 251/506] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:44.716261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.722788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.772964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09a94-ddd7-4141-965d-08a4b730357f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.805238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.805772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.806054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.806325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.806984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:44.807322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.808678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.811335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.814996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e8ef0-8626-435e-a3df-868d4b06dc63 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.816845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 256/507] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:44.817627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.850600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.851265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.851529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.851802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.861509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.862990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:44.877144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:44.878185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:44.879778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:44.879778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:44.879778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:44.879778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 252/508] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:44.880004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:44.916445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd2d2-afa6-482a-b9e9-b82ca69680c8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.929295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.949889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:44.950888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.951186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.951465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.962925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:44.964454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:44.978359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4cd8f-1876-4028-9df9-62570cb36f20 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:44.978483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:44.979515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:44.980379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:44.980379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:44.980379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:44.980379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 257/509] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:44.980588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.013002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.013606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.013876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.014144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.014860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:45.015183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.016595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.053454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 253/510] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:45.054267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.067749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.079502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77fbd-4694-4f1e-9587-66f5f896990a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.112236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.113351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.113628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.113897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.114529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:45.114827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.116224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.127716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 258/511] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:45.129135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.154930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.156147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29853-4111-40ec-8d09-1a780fe03a28 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.189500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.190121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.190405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.190676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.201085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.202561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:45.217359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:45.218358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:45.219217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:45.219217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:45.219217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:45.219217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 254/512] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:45.219217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.229113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383049c4-2f54-4ab2-ae47-7a3d1eadd9b6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.262655 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.263270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.263550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.263822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.264454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:45.264755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.266130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.277193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 259/513] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:45.277959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.342391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.360097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.375728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e51dd-ad43-4207-ade2-9aa225522b18 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.382977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c096-7b0d-4b49-8849-716179763f07 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.408196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.408794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.409072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.409341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.415865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.416458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.416734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.417004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.417637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:45.417933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.419345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.431927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 255/514] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:45.432749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.479211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.480664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.534218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b76e-4ee9-4cb4-9f4c-0679dcc69a74 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.554398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.561769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.568134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.568755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.569032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.569303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.576108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.577562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.578124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 260/515] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:45.579013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:45.590447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:45.591562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 256/516] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:45.592504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.688528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c18f-bd81-4f40-b70f-631ff9fadab7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.694617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515013c4-8c27-4325-aab2-8fe5d35bfba5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.721452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.722169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.722448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.722723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.723394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:45.723697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.725063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.727304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.727922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.728199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.728477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.734915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.735915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 261/517] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:45.736389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.736681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:45.752772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:45.754231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 257/518] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:45.755538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.790441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.796358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.842829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f851b-4c11-4379-9c0d-004f44d6205c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.853301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ed5a-5d52-4c4f-ad94-0e1c4b4a6fcb None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.875570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.876171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.876447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.876721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.877361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.879388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.886848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.887509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.887784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.888060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.898770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.900305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:45.914213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:45.915117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:45.915981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:45.915981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:45.915981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:45.915981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 258/519] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:45.916203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.956863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 262/520] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:26:45 2022] POST /identity/v3/users => generated 247 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:26:45.957808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.025409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.035091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd0aab-c3a0-464f-ae84-4a10d5ef0df4 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.068498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.071478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed764c8-3ce3-409b-9570-128afa26885d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.073017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.073626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.073913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.074191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.074936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:46.075468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.077032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.102178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 259/521] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:46.102178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.110054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.111075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.111075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.111381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.120278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.121737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:46.134302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:46.135308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:26:46.136373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:46.137008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 263/522] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:46.137826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.215000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97423-bd9a-4dd1-96f0-e3ad097f08b7 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.251575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607245f-6556-4ae8-870f-d0d3d9f7a123 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.255064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.255945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.256285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.256651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.257418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:46.257793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.259318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.282896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 260/523] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:46.282896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.290217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.290836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.291114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.291415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.292505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:46.292809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.294539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.295598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.309635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 264/524] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:46.310527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.334365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.392689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb4fa-8ef9-4dcf-bbf5-58759a25eaba None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.419540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa758c-dd89-440f-865f-c3cbba55f57d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.428475 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.429213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.429597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.429970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.457901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286a911-2d5c-400f-8948-004347788169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.458649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286a911-2d5c-400f-8948-004347788169 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.459183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286a911-2d5c-400f-8948-004347788169 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.459560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286a911-2d5c-400f-8948-004347788169 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.460886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286a911-2d5c-400f-8948-004347788169 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:46.461195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286a911-2d5c-400f-8948-004347788169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.463262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286a911-2d5c-400f-8948-004347788169 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.487687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 265/525] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:46.488677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286a911-2d5c-400f-8948-004347788169 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.502236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.503775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.515668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.572362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.595721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286a911-2d5c-400f-8948-004347788169 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.613678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 261/526] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:46.613678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.635355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.636089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.636490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.636865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.637588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=1276878b8f0541398e54be24543abd85) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:46.637900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.639349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.655267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 266/527] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/role_assignments?user.id=1276878b8f0541398e54be24543abd85&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:46.655267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.743824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c08b0-0b2f-4b06-9d4a-bbc7c844ef8c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.762701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.779933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1340-d321-4cb4-a72a-0677ab9e22fe None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.787025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.787808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.788154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.788519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.796067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.797683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:46.810464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:46.811418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:46.812276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:46.816021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 262/528] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:46.818062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:46.820230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.820832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.821806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.822079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.834686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:46.910113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.912430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:46.930287 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27955-bc96-4075-9693-4ce1e14f977d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:46.968224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:46.969175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:46.971100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:46.971539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:46.986603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:46.989338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:47.008403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:47.009569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:47.010599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:47.010599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:47.010599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:47.016418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 263/529] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:47.017298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.044260 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:47.053140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 267/530] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:47.054159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.111352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:47.145749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0bb17-e4ba-4e6e-b504-000931ef6806 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:47.176041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0f47a-edf8-48d9-8375-29372c39abd0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:47.195596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:47.196522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.196932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.197710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.198807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:47.199249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:47.201300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.211879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:47.212483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.215825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.215825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.215825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:47.215825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:47.215825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.219308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 264/531] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:47.220241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.234779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 268/532] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:47.235691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.331819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:47.350492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d02c4b-7874-4f8f-ac7d-a8013e14a199 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:47.350930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780afe0-f705-431b-ada5-b4548a19bb71 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:47.353989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:47.391087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:47.391777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.392145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.392517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.399809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:47.401110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.401551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.401963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.403369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=6a2b14464bea4a81b2995c6f9289ec73) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:47.404100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:47.404614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:47.405835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.406043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.419528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 269/533] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/role_assignments?user.id=6a2b14464bea4a81b2995c6f9289ec73&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:47.419528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:47.434298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:47.435390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:47.436222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:47.436222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:47.436222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:47.436222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 265/534] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:47.444229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.612611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf99d0-231e-47cc-9b95-b978cb5bb9a2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:47.641099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd290-dad4-468e-abad-e6fa02d9bc50 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:47.667979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:47.668619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.668897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.669168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.688693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:47.690098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:47.706257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:47.707920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:47.709022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 270/535] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:47.713638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.716069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:47.716912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.717413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.717823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.718615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:47.719057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:47.720694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.722737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:47.745732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:47.747590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 266/536] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:47.755638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.839680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb9e3-3ded-4ef9-89ab-8274a7a520f3 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:47.879968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:47.880854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:47.881280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:47.881712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:47.882550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:47.883055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:47.885326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:47.906306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 271/537] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:47.912956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:47.973321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a77b1-f666-4605-9b5a-a13bb8dffe37 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:48.004099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:48.012571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf611246-7222-426a-84ba-a0294a25ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:48.013322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf611246-7222-426a-84ba-a0294a25ba5b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.013663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf611246-7222-426a-84ba-a0294a25ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.014100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf611246-7222-426a-84ba-a0294a25ba5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.020439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da93631-2d21-4033-af7d-aca354214fd7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:48.022050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf611246-7222-426a-84ba-a0294a25ba5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:48.023961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf611246-7222-426a-84ba-a0294a25ba5b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-bf611246-7222-426a-84ba-a0294a25ba5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:48.035482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:48.036520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:48.037543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:48.039243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 267/538] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:48.046480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843a7e6-1d13-4d61-a5fd-d88fc66b9e22 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.046480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843a7e6-1d13-4d61-a5fd-d88fc66b9e22 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.046480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843a7e6-1d13-4d61-a5fd-d88fc66b9e22 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.046480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 268/539] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:48.046480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843a7e6-1d13-4d61-a5fd-d88fc66b9e22 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:48.072218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ce425-6fde-43e9-8cbf-c564b4d130b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:48.073094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ce425-6fde-43e9-8cbf-c564b4d130b3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.073379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ce425-6fde-43e9-8cbf-c564b4d130b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.073651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ce425-6fde-43e9-8cbf-c564b4d130b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.074543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ce425-6fde-43e9-8cbf-c564b4d130b3 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=f5a7af0d09114d14a22cdb8291fe8b26) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:48.075201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ce425-6fde-43e9-8cbf-c564b4d130b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:48.077277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ce425-6fde-43e9-8cbf-c564b4d130b3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:48.084562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 272/540] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:47 2022] GET /identity/v3/role_assignments?user.id=f5a7af0d09114d14a22cdb8291fe8b26&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:48.085884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f5b62-f8f1-460c-83b3-1844d9fd6b92 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.086167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f5b62-f8f1-460c-83b3-1844d9fd6b92 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.086595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f5b62-f8f1-460c-83b3-1844d9fd6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.110787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-db4f5b62-f8f1-460c-83b3-1844d9fd6b92 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:48.112355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-db4f5b62-f8f1-460c-83b3-1844d9fd6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:48.137735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:48.204045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843a7e6-1d13-4d61-a5fd-d88fc66b9e22 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:48.259336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 273/541] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:48.271540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:48.272459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.272782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.273057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.273763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:48.274119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:48.275812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:48.290596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 269/542] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:48.300909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f5b62-f8f1-460c-83b3-1844d9fd6b92 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:48.425987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:48.456446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f5b62-f8f1-460c-83b3-1844d9fd6b92 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:48.513028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf35c9-f21e-4b8d-b937-6ce2780a9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:48.513547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf35c9-f21e-4b8d-b937-6ce2780a9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.513827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf35c9-f21e-4b8d-b937-6ce2780a9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.514096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf35c9-f21e-4b8d-b937-6ce2780a9ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.514823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf35c9-f21e-4b8d-b937-6ce2780a9ca1 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=94c7e57c93dd49a1a3e784002ae94fc8) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:48.515128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf35c9-f21e-4b8d-b937-6ce2780a9ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:48.516575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf35c9-f21e-4b8d-b937-6ce2780a9ca1 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:48.527570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 274/543] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:48 2022] GET /identity/v3/role_assignments?user.id=94c7e57c93dd49a1a3e784002ae94fc8&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:48.604379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:48.742457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764c1f-8ccb-4be0-8c68-d583cfb61f48 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.742754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764c1f-8ccb-4be0-8c68-d583cfb61f48 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.742993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764c1f-8ccb-4be0-8c68-d583cfb61f48 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.743317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831042-69e0-4594-b4c7-01107d067a6a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:48.744533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 275/544] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:48.752860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948949-ba80-494f-b1fb-03bf3f57243f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.753530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948949-ba80-494f-b1fb-03bf3f57243f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.754002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948949-ba80-494f-b1fb-03bf3f57243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.760235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:48.791830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:48.792473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.792800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.793082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.796088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-eb948949-ba80-494f-b1fb-03bf3f57243f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:48.797293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-eb948949-ba80-494f-b1fb-03bf3f57243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:48.817227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:48.826609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:48.827616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:48.828395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 270/545] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:48.847571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:48.991017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5f36a-100b-4dd5-847e-589dae904b52 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:48.996764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 276/546] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:49.052951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:49.053530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.053814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.054086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.054758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:49.055062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:49.056474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:49.065383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 271/547] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:49.072235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb948949-ba80-494f-b1fb-03bf3f57243f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.187470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.218594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb948949-ba80-494f-b1fb-03bf3f57243f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:49.268153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:49.269365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.269645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.269911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.281078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.283561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:49.285136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:49.318121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:49.319100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:49.319956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:49.319956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:49.319956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:49.328438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 277/548] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:49.344530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.348613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.455492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53774e-b3ce-4b9b-a7a9-c5b6646c239e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:49.490042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b44bf-ae3c-4ce7-a977-4c21f34112a0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:49.514936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:49.515605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.515934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.516328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.523512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.527827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:49.528356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.528634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.528896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.529828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:49.532149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:49.533553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:49.538929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:49.544188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:49.545141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:49.545944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 272/549] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:49.555365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.568050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 278/550] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:49.574310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.747529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.752860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52060275-e17e-4a67-b1b3-09be823805fe None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:49.757223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b5f26-658c-4c17-abdb-ae97aa4b6b02 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:49.806130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:49.806736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.807026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.807318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.808913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2a8aa-49ab-47be-b216-6d122192decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:49.809886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a8aa-49ab-47be-b216-6d122192decb None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.810407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a8aa-49ab-47be-b216-6d122192decb None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.810878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2a8aa-49ab-47be-b216-6d122192decb None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.811761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2a8aa-49ab-47be-b216-6d122192decb None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:49.812255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2a8aa-49ab-47be-b216-6d122192decb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:49.813874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2a8aa-49ab-47be-b216-6d122192decb None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:49.814722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:49.816818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:49.823869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 273/551] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:49.825408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7d5a-c6c0-4615-be83-6a21160dae36 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.825896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7d5a-c6c0-4615-be83-6a21160dae36 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.826383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7d5a-c6c0-4615-be83-6a21160dae36 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:49.831925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:49.832835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 279/553] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:49.833727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.835248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 274/553] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:49.836904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1f43-2ad5-42a8-bca8-64649316c7e9 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.837407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1f43-2ad5-42a8-bca8-64649316c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.837916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1f43-2ad5-42a8-bca8-64649316c7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.858664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8f2a1f43-2ad5-42a8-bca8-64649316c7e9 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:49.860403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8f2a1f43-2ad5-42a8-bca8-64649316c7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:49.880732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.943182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 275/554] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:49.943182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1f43-2ad5-42a8-bca8-64649316c7e9 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.947805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bace72-f516-47ae-8bda-35d5e97ef155 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.009256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.009992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.010271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.013217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.025864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.027337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:50.042623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:50.043564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:50.044430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:50.044430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:50.044430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:50.044430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 280/555] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:50.049379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.087873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.098461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1f43-2ad5-42a8-bca8-64649316c7e9 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.162717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.165458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.165744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.166016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.166744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:50.167043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.168504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.202683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 276/556] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:50.208153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.228361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.234628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16adf-a4a2-4cc3-a19a-0693be8b8779 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.296709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.297314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.297588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.297856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.298499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:50.298800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.300215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.317445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 281/557] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:50.318700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.367627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ef703-8265-4be9-b1e0-96a0c8f2cccb None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.411809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547eaf-f8ea-4d36-a7f8-20c08cf0bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.413026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547eaf-f8ea-4d36-a7f8-20c08cf0bd8c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.413615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547eaf-f8ea-4d36-a7f8-20c08cf0bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.414129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547eaf-f8ea-4d36-a7f8-20c08cf0bd8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.431288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.450500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c90ed-dbab-47f2-9679-409b36b853ff None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.491173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.492786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.493267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.493789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.494915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56547eaf-f8ea-4d36-a7f8-20c08cf0bd8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.496415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56547eaf-f8ea-4d36-a7f8-20c08cf0bd8c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.506638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:50.511575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:50.512485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:50.513309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 282/558] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:50.515228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.535781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.612859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 277/559] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:50.614448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27e3c-7792-4a95-80ba-c888e80c150d None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.614879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27e3c-7792-4a95-80ba-c888e80c150d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.615323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27e3c-7792-4a95-80ba-c888e80c150d None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.620905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 278/560] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:50.621682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b763bf-1615-43ef-abcf-76aea43aec73 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.621996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27e3c-7792-4a95-80ba-c888e80c150d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.661453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.662084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.662357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.662645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.670082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.671856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.676835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:50.688843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:50.690070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:50.691192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 283/561] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:50.692355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.738752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27e3c-7792-4a95-80ba-c888e80c150d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.772437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.772822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc8f1b-a806-4f5b-ba62-bc49f389f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.773422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc8f1b-a806-4f5b-ba62-bc49f389f772 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.773699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc8f1b-a806-4f5b-ba62-bc49f389f772 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.773976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc8f1b-a806-4f5b-ba62-bc49f389f772 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.774635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc8f1b-a806-4f5b-ba62-bc49f389f772 None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:50.774941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc8f1b-a806-4f5b-ba62-bc49f389f772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.776353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc8f1b-a806-4f5b-ba62-bc49f389f772 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.784151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 279/562] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:50.785820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fb6b-eec0-421b-9f34-369c101e8f44 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.786108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fb6b-eec0-421b-9f34-369c101e8f44 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.786439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fb6b-eec0-421b-9f34-369c101e8f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.794074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d42b-15c2-40a3-96d9-ab8df8f3187d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.804365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d392fb6b-eec0-421b-9f34-369c101e8f44 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:50.805796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d392fb6b-eec0-421b-9f34-369c101e8f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:50.827812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:50.828436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.828707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.828976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.839387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.840828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:50.855030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:50.856006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:50.856940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:50.856940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:50.856940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:50.856940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 284/563] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:50.856940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.873236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 280/564] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:50.874448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9280a2-21d9-4e1a-ab84-ec38a7ea8430 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:50.874729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9280a2-21d9-4e1a-ab84-ec38a7ea8430 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:50.874995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9280a2-21d9-4e1a-ab84-ec38a7ea8430 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:50.876248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 281/565] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:50.876922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9280a2-21d9-4e1a-ab84-ec38a7ea8430 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:50.925676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.974224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73b956-6aa4-47ed-8955-53712184bdc8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:50.993851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9280a2-21d9-4e1a-ab84-ec38a7ea8430 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.004581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.009952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.010557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.010833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.011100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.011852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:51.012152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.013581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.033933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 285/566] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:51.034799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.041658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c2b74-41d5-49d1-8482-129f5228b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.042297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c2b74-41d5-49d1-8482-129f5228b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.042728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c2b74-41d5-49d1-8482-129f5228b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.042850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c2b74-41d5-49d1-8482-129f5228b3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.053927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c2b74-41d5-49d1-8482-129f5228b3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.055392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c2b74-41d5-49d1-8482-129f5228b3f1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-191c2b74-41d5-49d1-8482-129f5228b3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:51.071036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:51.072144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:51.073069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:51.073069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:51.073069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:51.073069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 282/567] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:51.073731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933d091-925e-40c4-9697-125a051091e7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.074013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933d091-925e-40c4-9697-125a051091e7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.074282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933d091-925e-40c4-9697-125a051091e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.092403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d933d091-925e-40c4-9697-125a051091e7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:51.093569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d933d091-925e-40c4-9697-125a051091e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:51.155501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d3e04-b62b-4ff1-8bbc-abbc265ca158 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.169923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 283/568] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:51.170748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933d091-925e-40c4-9697-125a051091e7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.194010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.194845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.195390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.195730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.196454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:51.196864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.198101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.199354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.210842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 286/569] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:51.211478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.268082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.285843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933d091-925e-40c4-9697-125a051091e7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.323042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.323938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.324069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3766ef-1095-4905-9c5d-3a6d8368af1f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.324476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.324982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.337212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.338689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:51.354542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:51.355508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:51.356405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:51.356405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:51.356405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:51.356405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 284/570] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:51.356405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.365911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.366525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.366807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.367078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.367753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:51.368059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.369432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.383307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 287/571] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:51.384104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.435286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.464592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031809c-7fa9-4e38-a157-ce64cc12da30 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.484348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472df0-2875-4667-b079-0847c343e7f0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.493892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.499033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.499697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.505447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.505447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.510442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:51.515689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:51.517057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 285/572] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:51.518201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.519274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.519909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.520185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.520652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.529301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.530738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:51.542241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:51.543120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 288/573] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:51.544395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.619165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50b1a3-76d1-4897-952b-219cd95fe171 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.641377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e6df-379c-4c9d-9ac7-dda30fb63867 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.649017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.656049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.656659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.656941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.657214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.657870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:51.658187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.659603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.671145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 286/574] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:51.671950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.675625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.676501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.676781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.677057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.684430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.685911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:51.697464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:51.698555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:51.699734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 289/575] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:51.700448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.727826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.771476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c90f3-4ff9-4f3c-befa-9ea3243be30e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.799378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89585772-a8f0-4122-b960-ce8db443833e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.805373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.805991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.806268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.806537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.816984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:51.821789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:51.822885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:51.823963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 287/576] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:51.824810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.836284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.836882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.837159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.837427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.838177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:51.838482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.839881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.847685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 290/577] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:51.848450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.881447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.928502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b689d-c190-4c13-8ea4-968f81aac65d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.938721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:51.948479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3d18-504a-467d-8c81-8a26a1f55c30 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:51.961246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.961844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.962123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.962398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.963087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:51.963440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.964872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:51.976657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 288/578] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:51.977453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:51.985669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:51.986299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:51.986576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:51.986845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:51.994099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:51.995563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:52.007016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:52.007940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 291/579] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:52.009356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.078817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581af63-72b2-4199-978d-6950fc35ec4c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.091414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.107970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e5cea-7033-470b-9f4e-7c3d8c81f07b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.113288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.113885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.114162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.114433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.115176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:52.115484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.116912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.133970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 289/580] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 1 16:26:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:52.134759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.141025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.141619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.141896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.142166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.142819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:52.143117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.144489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.152468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 292/581] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:52.153234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.167723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.236018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ae87d-ca94-4666-9adb-e0f5943715fd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.250681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6135b01-dcd8-4627-b765-67e02b334f9f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.282928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.283555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.283831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.284584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.285305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=4a6f6e719b6f49828fb866b4795e7108) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:52.285606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.287015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.292224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 293/582] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/role_assignments?user.id=4a6f6e719b6f49828fb866b4795e7108&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:52.293063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.305235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.305891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.306168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.306676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.318639 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.320216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:52.336754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:52.337816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:52.338719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:52.338719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:52.338719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:52.338719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 290/583] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:52.338959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.369158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.390912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.419527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcea5d-80d2-46ec-be61-610e3e789e3f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.458088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.458696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.458972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.459296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.459613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16a473-ac1e-4c6d-9e51-45d7e12e6ec4 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.460057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:52.460276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.461693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.478470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 294/584] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:52.478470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.503921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.504593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.504869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.505256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.515618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.517302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:52.535076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:52.536296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:52.537392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:52.537392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:52.537392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:52.540946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 291/585] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:52.541678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.578779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315444-3fdd-4038-9744-461a8ac68ca2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.613595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.614358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.614737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.615008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.617708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.622705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.627266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.629526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:52.645476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:52.646867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:52.655980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:52.655980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:52.655980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:52.655980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 295/586] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:52.655980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.656841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0f6e-d08b-4b6d-8a67-c8980a63f33b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.692114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.692720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.692993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.693258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.693933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:52.694233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.695639 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.711573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 292/587] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:52.711573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.771130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af300-aa3e-417f-9c63-ec1eda17c9ba None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.807445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.808189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.808529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.808863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/1276878b8f0541398e54be24543abd85/roles/ab121134924143bbb0fc522f9e5a6354` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.814323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7e11-8888-4557-b2b7-d28fff236cdd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:52.825595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=1276878b8f0541398e54be24543abd85, role_id=ab121134924143bbb0fc522f9e5a6354)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.827129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.848465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:52.849064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.849343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.849612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.850253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:52.850557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:52.851936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:52.853363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.863843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 293/588] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:52.864629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.895393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 296/589] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:52 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/1276878b8f0541398e54be24543abd85/roles/ab121134924143bbb0fc522f9e5a6354 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:52.895393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:52.940966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.008522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae930-a3ca-4877-80ee-da92c42bdb11 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.038139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832c75d-ef67-4543-ad8f-f2f9cf808641 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.053377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.054147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.054520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.054886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.055661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:53.056113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.057544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.071099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 294/590] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:53.072217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.083548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.084267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.084546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.084925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.094833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.096332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:53.108737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:53.109692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:53.110632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 297/591] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:53.111229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.151388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.202433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973eaecd-720e-4ee3-9b26-7d299a2aa187 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.231690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.236540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667652c-6ce9-4163-b5a2-ca91788ace07 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.245857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.246493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.246769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.247044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.256944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.258422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.274394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:53.274596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:53.275706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:53.276995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:53.278422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.278882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.279365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.280692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 295/592] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:53.281550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.288523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.290343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:53.303371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:53.304526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:26:53.305702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:53.307927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 298/593] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:53.308927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.412524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9c6c-7888-4703-ac39-7f973c0c7861 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.415693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fae915-efba-45fc-9628-3bf865114c8a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.428888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.450003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.450612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.450890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.451273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.452007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:53.452311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.453775 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.453898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.454693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.455296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.455791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.456749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:53.457248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.458857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.472351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 296/594] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:53.472958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.473659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 299/595] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:53.478358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.519542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.577421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0134d2-5ce1-4851-9bc6-23a88734a20b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.580013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8e2e-026a-447a-b575-9cdca9011928 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.613593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.614276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.614552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.614855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.615668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:53.615973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.616076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.616726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.617005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.617275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.617437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.627555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.629029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.635700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 297/596] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:53.636289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:53.644418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:53.645361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:53.647020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:53.647020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:53.647020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:53.647020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 300/597] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:53.647821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.683709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.721827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.752573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173eb7-36f6-4507-9f39-c8b585de19bc None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.760728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95decec9-ff28-41a7-b889-185ebde4df87 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.789366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.789997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.790530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.790810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.799776 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.800711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.801230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.801647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/6a2b14464bea4a81b2995c6f9289ec73/roles/ab121134924143bbb0fc522f9e5a6354` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.803292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.805057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.819105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=6a2b14464bea4a81b2995c6f9289ec73, role_id=ab121134924143bbb0fc522f9e5a6354)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.820827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:53.823601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:53.824708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:53.825699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:53.825699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:53.825699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:53.825699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 301/598] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:53.825932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.907429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 298/599] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:53 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/6a2b14464bea4a81b2995c6f9289ec73/roles/ab121134924143bbb0fc522f9e5a6354 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:53.908379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.946737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e5d67-7e0b-4a7e-96f0-79a303323f1e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:53.977194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.992431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:53.993312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.993736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.994199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.995021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:53.996587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:53.998207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.013834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 302/600] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:54.020864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:54.105258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:54.130817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4071f57-2efc-4769-bda6-28eec9b3ca89 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.173973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.174496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.174803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.175076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.175752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:54.176060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.177537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.190507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504a6c-0675-410d-8362-e1b8d73da39a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.191303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 299/601] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:54.196646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:54.235878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f4b0-dd0f-4968-9857-ee383aa8e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.237436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f4b0-dd0f-4968-9857-ee383aa8e42c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.238005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f4b0-dd0f-4968-9857-ee383aa8e42c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.238431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f4b0-dd0f-4968-9857-ee383aa8e42c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.254180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f4b0-dd0f-4968-9857-ee383aa8e42c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.257023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f4b0-dd0f-4968-9857-ee383aa8e42c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-d618f4b0-dd0f-4968-9857-ee383aa8e42c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:54.279311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:54.280449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:54.281542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:54.283101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 303/602] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:54.289099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b42383-60cd-457f-9548-d15ed8f52447 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.289862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b42383-60cd-457f-9548-d15ed8f52447 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.289862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b42383-60cd-457f-9548-d15ed8f52447 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.291635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 304/603] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:54.292420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b42383-60cd-457f-9548-d15ed8f52447 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:54.350909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1aa8a-cc66-4430-9cb6-2b5dad2cb916 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.351552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:54.392399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fe6fe-1399-4fe3-80b0-34547666a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.393479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fe6fe-1399-4fe3-80b0-34547666a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.393788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fe6fe-1399-4fe3-80b0-34547666a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.395073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fe6fe-1399-4fe3-80b0-34547666a1c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.404563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fe6fe-1399-4fe3-80b0-34547666a1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.406499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fe6fe-1399-4fe3-80b0-34547666a1c6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.410278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6e8fe6fe-1399-4fe3-80b0-34547666a1c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:54.423218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:54.424356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:54.426092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 300/604] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:54.426685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b42383-60cd-457f-9548-d15ed8f52447 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.426773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c321a1-a69e-49fc-ab72-f2025863da9a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.426773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c321a1-a69e-49fc-ab72-f2025863da9a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.429332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c321a1-a69e-49fc-ab72-f2025863da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.450535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-60c321a1-a69e-49fc-ab72-f2025863da9a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:54.452091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-60c321a1-a69e-49fc-ab72-f2025863da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:54.466007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.467064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.467622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.468048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.468804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:54.469170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.471236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.489890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 305/605] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:54.491327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:54.547445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 301/606] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:54.551199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c321a1-a69e-49fc-ab72-f2025863da9a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:54.615538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56c901-9c7a-467c-9fc1-7e5ca4aef9cd None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.617610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:54.658541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.661127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.661406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.661678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.664678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:54.665160 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.666798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.682655 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 306/607] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:54.686476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:54.793053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c321a1-a69e-49fc-ab72-f2025863da9a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.830433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f52e9-b340-4b13-b72c-90a60b50f0d1 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.867800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.869115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.869596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.870039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/94c7e57c93dd49a1a3e784002ae94fc8/roles/ab121134924143bbb0fc522f9e5a6354` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.873484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:54.883871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa38e97-9104-4931-a8c7-69199a8d9b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.884602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa38e97-9104-4931-a8c7-69199a8d9b44 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.884964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa38e97-9104-4931-a8c7-69199a8d9b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.885306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa38e97-9104-4931-a8c7-69199a8d9b44 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/f5a7af0d09114d14a22cdb8291fe8b26/roles/ab121134924143bbb0fc522f9e5a6354` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.890723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=94c7e57c93dd49a1a3e784002ae94fc8, role_id=ab121134924143bbb0fc522f9e5a6354)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.892443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.900927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa38e97-9104-4931-a8c7-69199a8d9b44 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=f5a7af0d09114d14a22cdb8291fe8b26, role_id=ab121134924143bbb0fc522f9e5a6354)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.902451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa38e97-9104-4931-a8c7-69199a8d9b44 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.993238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 307/608] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:54 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/94c7e57c93dd49a1a3e784002ae94fc8/roles/ab121134924143bbb0fc522f9e5a6354 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:54.994323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:55.014139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:55.025563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 302/609] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:54 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/f5a7af0d09114d14a22cdb8291fe8b26/roles/ab121134924143bbb0fc522f9e5a6354 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:55.027064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a5e0-e698-40e2-b4ca-d69822f7a350 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.027440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a5e0-e698-40e2-b4ca-d69822f7a350 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.027792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a5e0-e698-40e2-b4ca-d69822f7a350 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.029274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 303/610] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:55.052094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e82fc6-7c71-4cdb-b9df-553f385f9e22 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.052441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e82fc6-7c71-4cdb-b9df-553f385f9e22 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.052809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e82fc6-7c71-4cdb-b9df-553f385f9e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.087205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-33e82fc6-7c71-4cdb-b9df-553f385f9e22 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:55.089774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-33e82fc6-7c71-4cdb-b9df-553f385f9e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:55.175889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46f33f-78fa-4a9d-9640-a6ade526c590 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:55.223333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 304/611] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:55.238231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:55.238955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.239335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.239682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.253631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:55.258602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:55.259558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:55.260397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:55.264133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 308/612] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:55.272294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e82fc6-7c71-4cdb-b9df-553f385f9e22 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:55.378985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e82fc6-7c71-4cdb-b9df-553f385f9e22 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:55.389998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:55.414374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:55.415038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.415344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.415614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.416335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:55.416642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:55.418015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:55.427286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 305/613] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:55.436239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:55.533342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:55.543499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:55.585378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d463f0-56b5-4d0a-88ce-7c04756e4001 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:55.662722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a7e5-ce6b-416e-958b-8ef2ad080a18 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:55.663963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:55.664598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.664873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.665146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.692009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:55.693464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:55.706815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:55.707485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.707764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.708035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:55.720354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:55.721311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:55.722810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:55.722810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:55.722810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:55.722810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 309/614] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:55.729924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:55.733829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:55.748997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:55.749988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:55.750816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 306/615] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:55.756964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:55.819013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:55.909807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ed855-7f16-433f-852c-c407510b4c9a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:55.927112 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71ca98-0831-41b7-8f28-f763db16c853 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:55.955839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:55.964572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:55.965183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.965463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.965736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.966405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:55.966709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:55.968877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:55.980423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:55.981047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.981327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.981602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.982256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:55.982559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:55.983960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:55.988139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 307/616] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:26:55.998745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.014683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 310/617] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:56.021880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.152409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfbfb8-9a87-4be6-9e78-e4ea1d2d029c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.168793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.177433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac08b9-b28c-43ad-af43-49e2775a2907 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.193442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c2e87-adf9-4496-8434-3bc52586e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.194124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c2e87-adf9-4496-8434-3bc52586e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.194395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c2e87-adf9-4496-8434-3bc52586e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.194672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c2e87-adf9-4496-8434-3bc52586e1c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.204308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c2e87-adf9-4496-8434-3bc52586e1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:56.209736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c2e87-adf9-4496-8434-3bc52586e1c3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:56.218213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099550b-ba3f-4c2c-bddb-dff8d4bce940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6d1c2e87-adf9-4496-8434-3bc52586e1c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:56.218864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:56.220125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:56.221213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 311/618] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:56.221938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c5a9-7516-43d8-91c1-580b3e899664 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.222016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c5a9-7516-43d8-91c1-580b3e899664 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.226877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c5a9-7516-43d8-91c1-580b3e899664 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.227822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 312/619] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:56.227937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099550b-ba3f-4c2c-bddb-dff8d4bce940 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.227937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099550b-ba3f-4c2c-bddb-dff8d4bce940 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.228415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192c5a9-7516-43d8-91c1-580b3e899664 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.228650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099550b-ba3f-4c2c-bddb-dff8d4bce940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.241675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099550b-ba3f-4c2c-bddb-dff8d4bce940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:56.243633 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099550b-ba3f-4c2c-bddb-dff8d4bce940 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-5099550b-ba3f-4c2c-bddb-dff8d4bce940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:56.260401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:56.261397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:56.262274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:56.262274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:56.262274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:56.264565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 308/620] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:56.266168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590ca5-3480-44fe-b70e-7af62d1dacee None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.266742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590ca5-3480-44fe-b70e-7af62d1dacee None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.267318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590ca5-3480-44fe-b70e-7af62d1dacee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.282137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.287234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-81590ca5-3480-44fe-b70e-7af62d1dacee None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:56.288438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-81590ca5-3480-44fe-b70e-7af62d1dacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:56.344401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192c5a9-7516-43d8-91c1-580b3e899664 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.365542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 309/621] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:56.366399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590ca5-3480-44fe-b70e-7af62d1dacee None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.399528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.400276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.400644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.401009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.401879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:56.402359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:56.404057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:56.443227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 313/622] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:56.448553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.449002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.473026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590ca5-3480-44fe-b70e-7af62d1dacee None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.512048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.512874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.513157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.513427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.514087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:56.514392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:56.516015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:56.530197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 310/623] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:56.536068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.640818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29233523-a2aa-4bd9-a113-be405b533886 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.679967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe21c80-c578-4087-8eac-e46996e4f693 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.681415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.686234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.687476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.687904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.691196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.691491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.697305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:56.698827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:56.712453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:56.713611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:56.714770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 311/624] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:56.719306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.733646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.734420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.734704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.734970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.745870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:56.747360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:56.761981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:56.763170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:56.764340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:56.764340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:56.764340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:56.764340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 314/625] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:26:56.764340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.827865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7940a0-afef-4c10-9fea-110fffec827e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.864175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.864803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.865081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.865350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.869417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094d3e-dd54-4136-9493-e967e511a8a8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.876287 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:56.882257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:56.883198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:56.884411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 312/626] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:56.885109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.906294 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:56.906902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.907278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.907559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.908339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:56.908643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:56.910114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:56.933641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 315/627] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:56.934471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.943856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.949834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.990313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d059f-ab08-46b1-a359-c3bd75d63977 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.027144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.028015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.028444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.028891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.029680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:57.030131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.031681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.042271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad222f-699c-4a5f-892a-99f4ed4e95e7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.045035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 313/628] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:57.046102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.081265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.081981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.082263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.082534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.083716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:57.083716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.085066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.094282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 316/629] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:57.095274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.152686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bce14b-ae07-4957-98e1-082ab9bd21ba None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.170762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.186787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.190403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.191280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.191740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.192186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.216941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11ef77-0acb-4982-906c-145b0cf6695e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.260309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.260961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.261241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.261512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.271040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.272118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.277370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.277479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:57.289650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:57.290599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:57.292047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:57.292489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 317/630] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:57.293153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.383935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 314/631] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:57.385148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.402239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.407199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be3e16-66d3-4fde-af31-cd802712a413 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.440885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade35f7-b2e9-4765-bf61-6be8de8c2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.441434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade35f7-b2e9-4765-bf61-6be8de8c2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.441711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade35f7-b2e9-4765-bf61-6be8de8c2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.441982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade35f7-b2e9-4765-bf61-6be8de8c2a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.443844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.452747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade35f7-b2e9-4765-bf61-6be8de8c2a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.459661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade35f7-b2e9-4765-bf61-6be8de8c2a2b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-2ade35f7-b2e9-4765-bf61-6be8de8c2a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:57.468015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:57.469128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:57.470010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:57.470010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:57.470010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:57.470010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 318/632] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:57.470433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70147f33-3d23-4d5b-99a0-3f34f960bcc4 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.470629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70147f33-3d23-4d5b-99a0-3f34f960bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.470812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70147f33-3d23-4d5b-99a0-3f34f960bcc4 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.472660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 319/633] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:57.473667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d882e-c309-465a-8aae-308cf55c5db6 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.474048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d882e-c309-465a-8aae-308cf55c5db6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.474520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d882e-c309-465a-8aae-308cf55c5db6 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.475710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 320/634] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:57.476576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d882e-c309-465a-8aae-308cf55c5db6 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.490595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642beb-9bbe-449f-9680-bb5946d6770d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.524607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.525227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.525501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.525767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.526444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:57.526743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.528192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.545064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 315/635] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:57.545064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.585084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d882e-c309-465a-8aae-308cf55c5db6 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.618023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad47f-df25-41ee-a37e-77e24e565bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.618651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad47f-df25-41ee-a37e-77e24e565bbe None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.618925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad47f-df25-41ee-a37e-77e24e565bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.619221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad47f-df25-41ee-a37e-77e24e565bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.620566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.630168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad47f-df25-41ee-a37e-77e24e565bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.631643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad47f-df25-41ee-a37e-77e24e565bbe None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.642979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b57ada-c27c-4466-a965-f5465907362a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-2ebad47f-df25-41ee-a37e-77e24e565bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:57.648422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:57.649516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:57.652723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:57.652723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:57.652723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:57.652723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 321/636] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:57.652723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34b56-a0ad-4669-9ae6-6e23a32de2c9 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.652723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34b56-a0ad-4669-9ae6-6e23a32de2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.652723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd34b56-a0ad-4669-9ae6-6e23a32de2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.668027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1cd34b56-a0ad-4669-9ae6-6e23a32de2c9 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:57.669213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1cd34b56-a0ad-4669-9ae6-6e23a32de2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:57.680635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10abb-61cb-4c46-a762-e4bad50fea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.681231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10abb-61cb-4c46-a762-e4bad50fea61 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.681510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10abb-61cb-4c46-a762-e4bad50fea61 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.681782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10abb-61cb-4c46-a762-e4bad50fea61 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.682416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10abb-61cb-4c46-a762-e4bad50fea61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:57.682721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10abb-61cb-4c46-a762-e4bad50fea61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.684105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10abb-61cb-4c46-a762-e4bad50fea61 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.696225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 316/637] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:57.697392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd788-b3d8-4184-93ec-c0bca86bb238 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.697676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd788-b3d8-4184-93ec-c0bca86bb238 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.697942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd788-b3d8-4184-93ec-c0bca86bb238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.701227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.715485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5bccd788-b3d8-4184-93ec-c0bca86bb238 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:57.716656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5bccd788-b3d8-4184-93ec-c0bca86bb238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:57.736356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 322/638] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:57.737807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd34b56-a0ad-4669-9ae6-6e23a32de2c9 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.786160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 317/639] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:26:57.786901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd788-b3d8-4184-93ec-c0bca86bb238 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.855981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd34b56-a0ad-4669-9ae6-6e23a32de2c9 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.862423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.898345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.899295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.899577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.899852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/4a6f6e719b6f49828fb866b4795e7108/roles/ab121134924143bbb0fc522f9e5a6354` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.900712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd788-b3d8-4184-93ec-c0bca86bb238 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.918032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=4a6f6e719b6f49828fb866b4795e7108, role_id=ab121134924143bbb0fc522f9e5a6354)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.919695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.939016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.939672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.939948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.940790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.941764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:57.942602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.944195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.960057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 318/640] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:57.963203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.000020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 323/641] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:26:57 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/4a6f6e719b6f49828fb866b4795e7108/roles/ab121134924143bbb0fc522f9e5a6354 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:26:58.001564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.040148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.105787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724da22c-4527-4bb5-9fe6-b661a89de3c1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.134482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.146019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.147314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.147766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.148026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.158610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76256e91-baa0-481e-b8a7-2617ee6cc104 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.160072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.161548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:58.175551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:58.176562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 319/642] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:58.177664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.202108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.202738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.203010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.203419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.217218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.217218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:58.228455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:58.230176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 324/643] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:58.232018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.298612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ae3a-00d3-4b5a-aa10-6436ef062e7d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.328234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.338952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.339687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.339967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.340238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.352266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:58.353603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3d12-6851-47fa-9452-d9ac20b27577 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:58.358927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:58.359913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:58.360814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:58.365427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 320/644] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:58.366310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.393887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.394553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.394831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.395103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.405963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:26:58.411427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:58.412603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:26:58.413659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:58.417317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 325/645] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:58.418178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.421766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.484355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980425a2-3ab3-4361-9f76-9e2edeffda77 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.520328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.520926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.521202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.521724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.522455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:58.522759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.524236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.530270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a277c-c718-4c5a-8f31-99e6735d1e2e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.546630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 321/646] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:58.546630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.569415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.570024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.570299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.570569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.571293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:58.571685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.573126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.580245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.590763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 326/647] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:58.590763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.664768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc3bb-e778-43dd-b404-9efd7da5e1a4 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.667860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.701698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.702367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.702826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.702962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.703577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:58.704053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.705684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.706506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f26a2-124e-43c5-ad5d-5a8c4a5d15cb None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.718980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 322/648] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:58.718980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.746359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.747242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.747675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.747949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.748616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:58.748915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.750274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.763939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 327/649] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:58.764583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.827637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4544c-6c66-4913-95a7-be746fa084be None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.828315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.861610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.862758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.863045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.863348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.873647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ae073-d422-4fed-9bf2-3232b80b60ca None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:58.898105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.910695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:58.911306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:58.911585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:58.912149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:58.912576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=1276878b8f0541398e54be24543abd85) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:58.912886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.914328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.920804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 328/650] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/role_assignments?user.id=1276878b8f0541398e54be24543abd85&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:58.921612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:58.948761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.950631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.057439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12a3e9-edbe-490e-96fc-bf1b9b0e9e22 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.077966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 323/651] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:59.079197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.085455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.101205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.101841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.102120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.102393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.119880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.121365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:59.139373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:59.140347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:59.142018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:59.142018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:59.142018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:59.142018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 329/652] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:59.142018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.161438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.204749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993306f8-7402-4005-9760-9fdc8bc48344 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.245451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.245451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.245939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.246217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.260965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.263129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.274945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46763-9a69-4b74-b690-485bfd187b12 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:59.278503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:59.279521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:59.281041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:59.281041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:59.281041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:59.281041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 324/653] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:59.281041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.321661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.322622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.323669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.324150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.339392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.342073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:26:59.362677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:59.363709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:26:59.364610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:26:59.364610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:26:59.364610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:59.367124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 330/654] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:59.368171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.394936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad48c8-ed1f-4ad6-aaea-e4282ef727f1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.405691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.415739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.434360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.435289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.435715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.436134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.436989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:59.437568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.439095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.458728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 325/655] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:59.459869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.497753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2c1a3-d1ec-4784-8f50-95eeae36c4f9 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.540694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.542211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.542585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.542954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.543743 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:59.544109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.545557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.564655 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 331/656] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:59.565550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.581025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe138b0-c430-41a2-a9a7-377104efcb7e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.620204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322ae38-b805-41af-8422-661d9771457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.621168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322ae38-b805-41af-8422-661d9771457f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.621659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322ae38-b805-41af-8422-661d9771457f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.622118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322ae38-b805-41af-8422-661d9771457f None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.623090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322ae38-b805-41af-8422-661d9771457f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:26:59.623649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322ae38-b805-41af-8422-661d9771457f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.625252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322ae38-b805-41af-8422-661d9771457f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.638489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 326/657] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:26:59.639949 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322ae38-b805-41af-8422-661d9771457f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.666661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.679871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2438-322f-43af-9933-c4eeeee25b82 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.691782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.718340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.719143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.719549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.719919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.728525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.730068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:59.742646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:59.743842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:26:59.745011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:59.746753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 332/658] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:59.747738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.765276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322ae38-b805-41af-8422-661d9771457f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.803698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.804613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.805041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.805497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.814182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.816645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:26:59.828991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:59.829971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:26:59.831079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:26:59.833573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 327/659] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:59.834591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.867566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b84ce-0f67-469c-aa2d-73b2f6579a6b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.910072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.911076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.911684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.912112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.921548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:59.923567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:26:59.939385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:26:59.940487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:26:59.941376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:26:59.943752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 333/660] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:26:59.945077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.958662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.959511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.963332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a3677-31ae-4fef-b900-f9179709c888 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:59.997263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:59.998199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.998708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.999604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.000569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:00.000947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.002877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.022341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 328/661] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:00.023207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.059450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726428b3-61ed-4041-95a0-8dbde9cc367b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.095661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205f0f7-d77a-4180-8710-4bfddc135735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.096183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205f0f7-d77a-4180-8710-4bfddc135735 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.096485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205f0f7-d77a-4180-8710-4bfddc135735 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.096760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205f0f7-d77a-4180-8710-4bfddc135735 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.097477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205f0f7-d77a-4180-8710-4bfddc135735 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:00.097779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205f0f7-d77a-4180-8710-4bfddc135735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.099217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205f0f7-d77a-4180-8710-4bfddc135735 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.122148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 334/662] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:00.122148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca1581-1be6-485e-b052-545384b6519a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.122148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca1581-1be6-485e-b052-545384b6519a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.122148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca1581-1be6-485e-b052-545384b6519a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.122148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 335/663] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:00.122148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca1581-1be6-485e-b052-545384b6519a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.132401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a965744-6a74-4062-9bec-eb680f406afa None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.171351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.172258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.172736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.173077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.173848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:00.174226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.175772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.187917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 329/664] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:00.188701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.196116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.207580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.234018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca1581-1be6-485e-b052-545384b6519a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.272591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb23a56-ea60-4134-ae2f-b1e2e1d76c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.273216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23a56-ea60-4134-ae2f-b1e2e1d76c54 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.273462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23a56-ea60-4134-ae2f-b1e2e1d76c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.273737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23a56-ea60-4134-ae2f-b1e2e1d76c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.294156 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523fc5a-08b2-4ead-ae02-8dc5061b212f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.332245 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.332860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.333123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.333394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.344341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb23a56-ea60-4134-ae2f-b1e2e1d76c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.345820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb23a56-ea60-4134-ae2f-b1e2e1d76c54 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.407692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.409758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.411111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.427489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.446712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 336/665] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:00.448157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836273b8-9838-479d-b037-7d5644a2c994 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.448587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836273b8-9838-479d-b037-7d5644a2c994 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.449031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836273b8-9838-479d-b037-7d5644a2c994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.468265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-836273b8-9838-479d-b037-7d5644a2c994 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:00.469448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-836273b8-9838-479d-b037-7d5644a2c994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:00.521275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 330/666] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:00.521275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.542340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 337/667] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:00.543078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836273b8-9838-479d-b037-7d5644a2c994 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.629390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f01de0-9d58-4a30-820d-2ba89e2ec9b9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.642970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836273b8-9838-479d-b037-7d5644a2c994 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.655192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.677387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.678090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.678372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.678643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.679394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=6a2b14464bea4a81b2995c6f9289ec73) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:00.679703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.680133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.683643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.684643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.685276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.685736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.686003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.696062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 331/668] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/role_assignments?user.id=6a2b14464bea4a81b2995c6f9289ec73&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:00.697098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.697629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.699296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:00.717701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:00.719212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:00.720105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:00.720105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:00.720105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:00.720105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 338/669] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:00.725549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.849692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0250466-e51f-48b2-b33c-541090fbaab4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.888128 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44ead-234f-4095-a2d2-07bf9043c367 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.896231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.897114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.897392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.897663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.898322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:00.898627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.900565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.917725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 339/670] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:00.918622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.933240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.941502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.942140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.943351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.943351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.957642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.959109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:00.978252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:00.979332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:00.980252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:00.980252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:00.980252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:00.980252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 332/671] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:00.980524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.023052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.047532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de2f2-0265-4829-accd-d9db66b90949 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.097648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.097648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.097648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.097648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.109258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:01.115195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:01.116105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:01.116933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 340/672] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:01.117681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.119463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689518c7-fef8-4cf5-97d2-a82535f65919 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.155296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4b3a8-e832-4bc4-a5a4-0fdb019e7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.155819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4b3a8-e832-4bc4-a5a4-0fdb019e7f2b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.156096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4b3a8-e832-4bc4-a5a4-0fdb019e7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.156380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4b3a8-e832-4bc4-a5a4-0fdb019e7f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.163597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4b3a8-e832-4bc4-a5a4-0fdb019e7f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.165064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4b3a8-e832-4bc4-a5a4-0fdb019e7f2b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-53a4b3a8-e832-4bc4-a5a4-0fdb019e7f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:01.177132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:01.178043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:01.178934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:01.182903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 333/673] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:01.184028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46b71-2dbc-419d-9f10-1dfbe8361bd9 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.184309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46b71-2dbc-419d-9f10-1dfbe8361bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.184580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46b71-2dbc-419d-9f10-1dfbe8361bd9 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.185859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 334/674] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:01.186538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46b71-2dbc-419d-9f10-1dfbe8361bd9 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.199887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.237911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d66a1-04d4-4c5c-9bdb-09794e08428f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.283256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.284717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.285005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.285277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.286097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:01.286402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.288222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.301246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.307573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 341/675] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:01.307573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.318454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46b71-2dbc-419d-9f10-1dfbe8361bd9 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.357069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883fee8-a814-49f2-914d-29998c35e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.358026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883fee8-a814-49f2-914d-29998c35e21b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.358510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883fee8-a814-49f2-914d-29998c35e21b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.360012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883fee8-a814-49f2-914d-29998c35e21b None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.361706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883fee8-a814-49f2-914d-29998c35e21b None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:01.361706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883fee8-a814-49f2-914d-29998c35e21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.364632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883fee8-a814-49f2-914d-29998c35e21b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.378640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 335/676] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:01.378640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8449c-a2d3-4b53-affb-0d25fa7c52d3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.378640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8449c-a2d3-4b53-affb-0d25fa7c52d3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.378640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8449c-a2d3-4b53-affb-0d25fa7c52d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.395106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9ee8449c-a2d3-4b53-affb-0d25fa7c52d3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:01.396974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9ee8449c-a2d3-4b53-affb-0d25fa7c52d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:01.434561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df687ca-1698-4ad5-9733-c4de4f007ae1 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.466286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.471964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 336/677] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:01.474166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.474769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.475089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.475372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.476059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:01.480952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.480952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.484485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8449c-a2d3-4b53-affb-0d25fa7c52d3 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.494355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 342/678] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:01.495454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.615042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.618345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55453af-af37-47a2-86e5-46f72e0c49bf None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.635867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8449c-a2d3-4b53-affb-0d25fa7c52d3 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.665439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.666296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.666712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.667117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.682589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.682844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.683639 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.684012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.684378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.685004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.692043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.693667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:01.700700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:01.701660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:01.702538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:01.702538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:01.702538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:01.704556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 343/679] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:01.706198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:01.706843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:01.707727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:01.708618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 337/680] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:01.713473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.753813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.813011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54a98-bb36-4099-a494-1beb2de7b9a9 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.825646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843c5ba-c86a-4124-8ef7-922b89f927d7 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.847779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.868145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.868145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.868145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.868145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=94c7e57c93dd49a1a3e784002ae94fc8) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:01.868145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.868145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.868614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 344/681] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/role_assignments?user.id=94c7e57c93dd49a1a3e784002ae94fc8&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:01.868614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.878298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.879065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.879372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.879700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.880507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:01.880812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.882618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.904445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 338/682] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:01.905582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:01.926582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.980198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381fd97-10bb-4c7b-9b71-523832c159c5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.983756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:02.017746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.018403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.018681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.018953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.019643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:02.019946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.021327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:02.041831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 345/683] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:02.042792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.053686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4631-9f9b-4475-af89-eb4ec2378278 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.094153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.095246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.095752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.096022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.110497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:02.118470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:02.119544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:02.120444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:02.125922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 339/684] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:02.125922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.171984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0419a-702e-4f5a-9099-a905e4379fbf None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.209831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:02.212224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.213669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.213669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.213669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.215020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=f5a7af0d09114d14a22cdb8291fe8b26) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:02.216019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.217897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:02.225954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 346/685] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/role_assignments?user.id=f5a7af0d09114d14a22cdb8291fe8b26&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:02.227502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.270104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972210d3-f283-46e4-8712-7e8510ada648 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.283868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:02.368384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.369392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.369828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.370259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.382459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238df752-5ebc-4bf7-a7ee-17bf758502c3 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.397740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.399712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:02.423570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:02.425117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:02.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:02.429212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 340/686] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:02.434276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.435905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.436520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.436795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.437065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.437745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:02.438046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.439605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:02.454995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 347/687] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:02.458345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.570147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef36daf-c855-4dfc-a360-5adb0651593c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.578057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:02.586644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b359a-3b72-4f79-9a4d-ecc3e37cb748 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.603638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:02.616749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.617425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.617700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.617972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.618818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:02.618999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.620743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:02.631996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.634148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.634603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.635034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.642526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 341/688] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:02.650877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.654406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.657359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:02.695622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:02.696852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:02.697975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:02.697975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:02.697975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:02.699478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 348/689] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:02.705179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.766819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870d6bf-79d5-4d51-b632-94559e539f50 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.823887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.824417 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.824693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.825010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.835596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0eef1-87a5-4b85-b919-ecdda31b9706 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:02.872635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:02.873631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.874112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.874616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.875523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:02.876041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.877663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:02.890748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 349/690] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:02.899387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:02.902528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:02.928316 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:02.969514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:02.971580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.011839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdff09-9d8e-44d7-88bd-07507b0b0309 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:03.055198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:03.055198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.055198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.055198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.062118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:03.064389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:03.078364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:03.079598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:03.080807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:03.082609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 350/691] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:03.092441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.138385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 342/692] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:03.139990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.227091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.227486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.246978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5c7c9-54d7-4258-8c31-ee91a0b4d84c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:03.293825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:03.294453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.294727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.294996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.298738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab37d61-965a-41f7-ab0b-8666a1a98b2e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:03.316337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:03.317793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.335570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:03.336590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.337029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.337452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.338334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:03.338815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:03.341234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:03.347056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:03.348226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:03.349141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:03.349141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:03.349141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:03.353013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 343/693] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:03.359077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.365476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 351/694] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:03.370526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.507708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734a46-41b6-4ea2-9456-46e309d960ba None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:03.525728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67c3cb-a9b4-4811-819b-5d1807510c7d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:03.547772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.554100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885b54-0232-4e21-82e4-ac2c2a7fafd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:03.554720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885b54-0232-4e21-82e4-ac2c2a7fafd4 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.555004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885b54-0232-4e21-82e4-ac2c2a7fafd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.555300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885b54-0232-4e21-82e4-ac2c2a7fafd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.556275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885b54-0232-4e21-82e4-ac2c2a7fafd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:03.556584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885b54-0232-4e21-82e4-ac2c2a7fafd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:03.558417 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885b54-0232-4e21-82e4-ac2c2a7fafd4 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.560447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.565443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:03.566506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.567087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.567626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.573795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 344/695] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:03.575032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e20b2-b7e3-43eb-a868-198d561e02fc None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.575341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e20b2-b7e3-43eb-a868-198d561e02fc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.575618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e20b2-b7e3-43eb-a868-198d561e02fc None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.577241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 345/696] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:03.579037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e20b2-b7e3-43eb-a868-198d561e02fc None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.667630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:03.669084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.707306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e20b2-b7e3-43eb-a868-198d561e02fc None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:03.744332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c545b79-175a-439d-9355-7f44403157ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:03.744902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545b79-175a-439d-9355-7f44403157ac None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.745188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545b79-175a-439d-9355-7f44403157ac None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.745460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545b79-175a-439d-9355-7f44403157ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.753765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c545b79-175a-439d-9355-7f44403157ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:03.755375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c545b79-175a-439d-9355-7f44403157ac None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-8c545b79-175a-439d-9355-7f44403157ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:03.768054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:03.769015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:03.769910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 346/697] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:03.770866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337d2fd-1d5e-40c2-aad0-246b820557e3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.770977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337d2fd-1d5e-40c2-aad0-246b820557e3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.771185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337d2fd-1d5e-40c2-aad0-246b820557e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.790009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-7337d2fd-1d5e-40c2-aad0-246b820557e3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:03.791254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7337d2fd-1d5e-40c2-aad0-246b820557e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:03.807244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 352/698] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:03.808383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.835981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.851065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.873818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 347/699] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:03.874762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337d2fd-1d5e-40c2-aad0-246b820557e3 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.958820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2f59-945f-47c0-b4ab-e89c720a534b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.030089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.030712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.030990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.031287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.031987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:04.032291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.034288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.064034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 353/700] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:04.067019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337d2fd-1d5e-40c2-aad0-246b820557e3 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.070167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.136563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.137199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.137733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.138010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.155810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.157305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:04.177275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:04.178273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:04.179178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:04.179178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:04.179178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:04.179178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 348/701] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:04.179863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.207497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.224782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.230048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0f88-c594-49c0-8810-7e57d3344875 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.272691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.273766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.274253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.274743 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.275771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=4a6f6e719b6f49828fb866b4795e7108) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:04.276293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.278111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.285675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 354/702] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/role_assignments?user.id=4a6f6e719b6f49828fb866b4795e7108&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:04.287294 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.310910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28de5-b344-43da-a8d1-24f2156c6416 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.357309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.357981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.358262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.358670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.376238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.378204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:04.398038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:04.399088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:04.400375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:04.400375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:04.400375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:04.400375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 349/703] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:04.405880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.414904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed962b-b11e-4bf0-a135-934b58b627fe None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.455769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd64fa-4256-47cf-af5d-e0ab27d30366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.456739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd64fa-4256-47cf-af5d-e0ab27d30366 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.457241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd64fa-4256-47cf-af5d-e0ab27d30366 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.457723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd64fa-4256-47cf-af5d-e0ab27d30366 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.458591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd64fa-4256-47cf-af5d-e0ab27d30366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:04.459130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd64fa-4256-47cf-af5d-e0ab27d30366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.460896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd64fa-4256-47cf-af5d-e0ab27d30366 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.475435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 355/704] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:04.477580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05d893-fca0-4ff4-a64d-534379ff0f28 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.478338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05d893-fca0-4ff4-a64d-534379ff0f28 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.479032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05d893-fca0-4ff4-a64d-534379ff0f28 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.481051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 356/705] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:04.482042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05d893-fca0-4ff4-a64d-534379ff0f28 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.486167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.529584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.544209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba16fe-9df0-4298-9b6e-7ecb223de703 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.600289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcab48-081d-4188-a107-9da7350ef094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.601565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcab48-081d-4188-a107-9da7350ef094 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.602047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcab48-081d-4188-a107-9da7350ef094 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.602518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcab48-081d-4188-a107-9da7350ef094 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.603424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcab48-081d-4188-a107-9da7350ef094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:04.603931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcab48-081d-4188-a107-9da7350ef094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.606007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcab48-081d-4188-a107-9da7350ef094 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.621554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 350/706] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:04.622591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05d893-fca0-4ff4-a64d-534379ff0f28 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.622933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecca8b-7616-4e66-afb1-b85e8e9f6fac None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.623286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecca8b-7616-4e66-afb1-b85e8e9f6fac None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.623560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecca8b-7616-4e66-afb1-b85e8e9f6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.647349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-49ecca8b-7616-4e66-afb1-b85e8e9f6fac None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:04.648479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-49ecca8b-7616-4e66-afb1-b85e8e9f6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:04.671273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.672271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.672800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.673377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.681127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.683267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:04.695401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:04.696313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:04.697219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 357/707] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:04.697706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.721021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 351/708] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:04.723483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faed12-e37d-48b9-8dd2-2f47c433f6f6 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.723773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faed12-e37d-48b9-8dd2-2f47c433f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.724046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faed12-e37d-48b9-8dd2-2f47c433f6f6 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.726487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 352/709] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:04.727567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faed12-e37d-48b9-8dd2-2f47c433f6f6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.767809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.811132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520db72-a3cb-4434-851a-97b5efcc9397 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.814484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.839517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faed12-e37d-48b9-8dd2-2f47c433f6f6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.848942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.849551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.849813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.850081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.850725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.852297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.879255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1315db-c73f-400c-ab58-52fb7555409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.879951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1315db-c73f-400c-ab58-52fb7555409a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.880399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1315db-c73f-400c-ab58-52fb7555409a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.880981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1315db-c73f-400c-ab58-52fb7555409a None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.882388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1315db-c73f-400c-ab58-52fb7555409a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:04.882769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1315db-c73f-400c-ab58-52fb7555409a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.884353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1315db-c73f-400c-ab58-52fb7555409a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.899256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 353/710] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:04.900411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f6f5-c2d8-40e8-a3ba-812ce644f3af None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.900694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f6f5-c2d8-40e8-a3ba-812ce644f3af None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.900965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f6f5-c2d8-40e8-a3ba-812ce644f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.922353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 358/711] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:27:04 2022] POST /identity/v3/users => generated 254 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:04.927191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.936429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-71f6f6f5-c2d8-40e8-a3ba-812ce644f3af None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:04.937691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-71f6f6f5-c2d8-40e8-a3ba-812ce644f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:05.069682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 354/712] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:05.070900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6f6f5-c2d8-40e8-a3ba-812ce644f3af None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:05.098642 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649abfc3-d03a-4eb1-a6f5-a9883dbe25e0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:05.120138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:05.139355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:05.140246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:05.148925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:05.148925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:05.149134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:05.149228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=1276878b8f0541398e54be24543abd85) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:05.149228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:05.149228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:05.151174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 359/713] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/role_assignments?user.id=1276878b8f0541398e54be24543abd85&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:05.184485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6f6f5-c2d8-40e8-a3ba-812ce644f3af None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:05.235400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:05.236067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:05.236437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:05.237277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] PATH_INFO: `/v3/services/network` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:05.237890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:05.239355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:05.253477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:05.254901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:05.256151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:05.258435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 355/714] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:05 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:05.264477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:05.373937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:05.375813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5748d-f0e2-4196-812b-cd11608353fa None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:05.424890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:05.426381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:05.426962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:05.427440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:05.428526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] RBAC: Adding query filter params (name=network) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:05.429011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:05.431358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:05.438111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 360/715] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:05.443822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:05.487518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac55451-7ada-43a1-923e-154d1c75d373 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:05.496289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:05.519499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:05.525421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:05.526055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:05.526385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:05.526659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:05.527384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:05.528777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:05.538888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:05.539961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:05.540792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 356/716] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Sep 1 16:27:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:05.545836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:05.559764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca7f2-75de-426e-ac2b-53542bde6854 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:05.595017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:05.596581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:05.597067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:05.597541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:05.598370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] RBAC: Adding query filter params (type=network) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:05.598874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:05.600473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:05.606667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 361/717] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:05.659879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780e68-3e45-4f4e-a968-befb03e5f91c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:05.700590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efce195-0990-443f-8851-5e59d09e4e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:05.701214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce195-0990-443f-8851-5e59d09e4e5e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:05.701492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce195-0990-443f-8851-5e59d09e4e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:05.701761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce195-0990-443f-8851-5e59d09e4e5e None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:05.702403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce195-0990-443f-8851-5e59d09e4e5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:05.702703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce195-0990-443f-8851-5e59d09e4e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:05.704142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce195-0990-443f-8851-5e59d09e4e5e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:05.710064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 357/718] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 1 16:27:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:05.715780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:05.841389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b917e6a-9bc2-4e0e-971c-a7421511917d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:05.855846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:05.881285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246d443-6721-4db0-8d13-f66e25218a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:05.881926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246d443-6721-4db0-8d13-f66e25218a86 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:05.882201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246d443-6721-4db0-8d13-f66e25218a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:05.882470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246d443-6721-4db0-8d13-f66e25218a86 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:05.883104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246d443-6721-4db0-8d13-f66e25218a86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:05.883461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246d443-6721-4db0-8d13-f66e25218a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:05.884878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246d443-6721-4db0-8d13-f66e25218a86 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:05.889948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 362/719] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 1 16:27:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:06.707273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc10a-cb0b-44b6-a711-1adec1672ebd None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:06.707805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc10a-cb0b-44b6-a711-1adec1672ebd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:06.707805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc10a-cb0b-44b6-a711-1adec1672ebd None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:06.709397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 358/720] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:06.714563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fee69-f57b-4ec4-ae90-b082e330efcc None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:06.714855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fee69-f57b-4ec4-ae90-b082e330efcc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:06.715128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fee69-f57b-4ec4-ae90-b082e330efcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:06.740720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c54fee69-f57b-4ec4-ae90-b082e330efcc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:06.741977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c54fee69-f57b-4ec4-ae90-b082e330efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:06.826117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 363/721] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:07.153464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfc10a-cb0b-44b6-a711-1adec1672ebd None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:07.227773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:07.282823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfc10a-cb0b-44b6-a711-1adec1672ebd None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:07.341709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20e57-4f4c-4139-b89d-23efad31ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:07.342343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20e57-4f4c-4139-b89d-23efad31ef33 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.342621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20e57-4f4c-4139-b89d-23efad31ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.342891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20e57-4f4c-4139-b89d-23efad31ef33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.358908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e20e57-4f4c-4139-b89d-23efad31ef33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-f5e20e57-4f4c-4139-b89d-23efad31ef33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:07.364371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:07.365279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:07.366148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 359/722] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:07.371326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fee69-f57b-4ec4-ae90-b082e330efcc None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:07.503786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fee69-f57b-4ec4-ae90-b082e330efcc None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:07.517710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:07.530749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b497-4858-4865-831a-67e06d314aee None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.531032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b497-4858-4865-831a-67e06d314aee None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.531330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b497-4858-4865-831a-67e06d314aee None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.532726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 360/723] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:07.540666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21a264-bb7e-4ef2-af1d-d9219cdd55bf None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.541027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21a264-bb7e-4ef2-af1d-d9219cdd55bf None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.541380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21a264-bb7e-4ef2-af1d-d9219cdd55bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.570771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:07.571436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.571718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.571993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.572674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:07.572978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:07.574397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:07.576371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-bc21a264-bb7e-4ef2-af1d-d9219cdd55bf None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:07.577626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bc21a264-bb7e-4ef2-af1d-d9219cdd55bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:07.584343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 364/724] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:07.590568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:07.701547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 361/725] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:07.703433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a9cd-c658-4833-851f-23744c527a57 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.703715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a9cd-c658-4833-851f-23744c527a57 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.703986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a9cd-c658-4833-851f-23744c527a57 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.707229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 362/726] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:07.711483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec989a-bf25-4c05-9747-e9120736e3d6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.712139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec989a-bf25-4c05-9747-e9120736e3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.712139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec989a-bf25-4c05-9747-e9120736e3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.731019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-66ec989a-bf25-4c05-9747-e9120736e3d6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:07.732359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-66ec989a-bf25-4c05-9747-e9120736e3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:07.746114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4488-85d7-4333-9d61-7adeb7ee59ae None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:07.781830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:07.782469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.782709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:07.782819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.783829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.794555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:07.796022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:07.805707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 363/727] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:07.815309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:07.816458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:07.817726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:07.817726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:07.817726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:07.821955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec989a-bf25-4c05-9747-e9120736e3d6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:07.823468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 365/728] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:07.977790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec989a-bf25-4c05-9747-e9120736e3d6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.027917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.028529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.028807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.029077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.029720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:08.030019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.031413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.045642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 364/729] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:08.051037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.074557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.079911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.158851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.182094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f924d8-c70f-4cff-86fa-d19aa07174de None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.216037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da0bc-5abb-4c0b-807d-d5e3ea330946 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.227823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b9e73-340f-43ae-bd19-5f0b23e9aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.228413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b9e73-340f-43ae-bd19-5f0b23e9aacc None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.228695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b9e73-340f-43ae-bd19-5f0b23e9aacc None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.228967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b9e73-340f-43ae-bd19-5f0b23e9aacc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.242104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b9e73-340f-43ae-bd19-5f0b23e9aacc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.243658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b9e73-340f-43ae-bd19-5f0b23e9aacc None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ea2b9e73-340f-43ae-bd19-5f0b23e9aacc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:08.255921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:08.256846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:08.257769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 366/730] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:08.258343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52484e3-d900-4282-aaea-2c3a55511e1b None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.259005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52484e3-d900-4282-aaea-2c3a55511e1b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.259005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52484e3-d900-4282-aaea-2c3a55511e1b None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.260121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 367/731] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:08.260712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52484e3-d900-4282-aaea-2c3a55511e1b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.266241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.267196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.267488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.267795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.281271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:08.288118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:08.289019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:08.289876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:08.291175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 365/732] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:08.291175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.346259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.367479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52484e3-d900-4282-aaea-2c3a55511e1b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.393181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.397076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74336-4add-4a14-91ef-f7d3fba57ed1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.402319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca05b7-7e00-4af9-bf49-4826a44fb749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.408146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca05b7-7e00-4af9-bf49-4826a44fb749 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.408146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca05b7-7e00-4af9-bf49-4826a44fb749 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.408146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca05b7-7e00-4af9-bf49-4826a44fb749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.414144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca05b7-7e00-4af9-bf49-4826a44fb749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-efca05b7-7e00-4af9-bf49-4826a44fb749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:08.418937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:08.419891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:08.420714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 368/733] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:08.427179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423c263-fb15-4689-a703-25a500ec7c75 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.427179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423c263-fb15-4689-a703-25a500ec7c75 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.427179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423c263-fb15-4689-a703-25a500ec7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.439489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.440642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.440932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.441193 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.441921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:08.442224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.443690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.445713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5423c263-fb15-4689-a703-25a500ec7c75 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:08.447110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5423c263-fb15-4689-a703-25a500ec7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.463640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 366/734] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:08.465167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.518174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 369/735] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:08.519399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423c263-fb15-4689-a703-25a500ec7c75 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.570822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c297a5-592a-4135-96a1-6bf896c2728c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.597695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.605499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.606098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.606432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.606661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.607350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:08.607652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.614230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.622013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 367/736] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:08.622013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.636923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423c263-fb15-4689-a703-25a500ec7c75 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.641701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.678962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf92d20-3eb9-4ee1-a283-54ae2a7f5434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.679835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92d20-3eb9-4ee1-a283-54ae2a7f5434 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.680260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92d20-3eb9-4ee1-a283-54ae2a7f5434 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.680672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92d20-3eb9-4ee1-a283-54ae2a7f5434 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.681470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf92d20-3eb9-4ee1-a283-54ae2a7f5434 None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:08.681933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf92d20-3eb9-4ee1-a283-54ae2a7f5434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.683486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf92d20-3eb9-4ee1-a283-54ae2a7f5434 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.691738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 370/737] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:08.693090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf77c8-3aba-4054-83e3-6d7cbb74697d None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.693516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf77c8-3aba-4054-83e3-6d7cbb74697d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.693950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf77c8-3aba-4054-83e3-6d7cbb74697d None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.695325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 371/738] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:08.696197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf77c8-3aba-4054-83e3-6d7cbb74697d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.740029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde9d63-4f86-4d41-89a0-44c530d176ae None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.775462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19510d9a-bc0e-42fa-9acd-2afe9193dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.776066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510d9a-bc0e-42fa-9acd-2afe9193dad8 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.776343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510d9a-bc0e-42fa-9acd-2afe9193dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.776614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510d9a-bc0e-42fa-9acd-2afe9193dad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.809440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf77c8-3aba-4054-83e3-6d7cbb74697d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.837425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.842180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.842803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.843083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.843385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.845394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19510d9a-bc0e-42fa-9acd-2afe9193dad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.847446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19510d9a-bc0e-42fa-9acd-2afe9193dad8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.854068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.855472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:08.868046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:08.869727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:08.870908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:08.871968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:08.871968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:08.871968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:08.871968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 372/739] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:08.871968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.945806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 368/740] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:08.947009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7afe24-8dfd-410b-88cd-69d43d5d4e0a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.947363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7afe24-8dfd-410b-88cd-69d43d5d4e0a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.947630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7afe24-8dfd-410b-88cd-69d43d5d4e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.965303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6d7afe24-8dfd-410b-88cd-69d43d5d4e0a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:08.966479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6d7afe24-8dfd-410b-88cd-69d43d5d4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.972309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de9e95-39ee-4bdb-bca1-03c56fa4d862 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.005307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.005921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.006198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.006466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.017707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.019147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.031795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 369/741] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:27:09.032645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7afe24-8dfd-410b-88cd-69d43d5d4e0a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:09.033277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:09.034240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:09.035114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:09.035114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:09.035114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:09.035335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 373/742] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:09.036118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.078446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:09.092104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:09.144171 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7afe24-8dfd-410b-88cd-69d43d5d4e0a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.148509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35bc3c-6aa3-43b8-a354-8288a5089baa None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.178923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.179557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.179837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.180106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.180752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.182128 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.189173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.189858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.190139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.190411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.191047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:09.191380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.192732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.204313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 374/743] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:09.205598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.278273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 370/744] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:09 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:09.279103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.316109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:09.323086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8c22-127a-4653-8845-bf2e3210c193 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.374910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.375890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.376171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.376442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.390360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.391940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.405304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f41b-bfc1-4b62-9b22-2dbf0760bd38 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:09.407653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:09.409645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:09.410764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:09.410764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:09.410764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:09.413983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 375/745] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:09.415270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.422006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:09.453023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.453023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.453023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.453023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.453617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:09.453928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.455874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.470527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 371/746] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:09.475222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.533065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99019c-76bb-41ae-b2bc-bb960535a740 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.567057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.567708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.567994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.568262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.575548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.576975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.579496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a572c1-80a2-4713-bbee-0e8ca019622f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:09.588271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:09.589550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:09.590712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:09.594574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 376/747] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:09.595433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.599513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:09.620460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.621555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.621903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.622430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.623075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.625415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.698937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16afb6-14a9-4b1c-8d18-b10cd2de0189 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.702038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 372/748] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:09 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:09.702380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.749679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.750346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.750631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.750901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.751616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:09.751926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.753834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.754250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:09.773062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 377/749] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:09.774028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.843051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f4ef-f4d2-4fdf-bf71-01dfb1835361 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.854641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:09.892341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.893928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.894395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.894981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.903986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.904276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90e63-0840-4787-9509-d303a68d0db5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:09.905448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:09.918230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:09.919400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:09.920352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 373/750] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:09.920939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:09.947626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:09.948344 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:09.948732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:09.949129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:09.949875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:09.950247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:09.951828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.972697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 378/751] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:09.973504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.044313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.058145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ecbf0-2b83-427d-b209-030fc78cfe8a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.097150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e38e-c37e-4526-a41b-9a5206e1c210 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.105526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.106241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.106593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.107357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.116033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.117928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.119785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:10.136580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:10.137511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:10.138390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:10.138822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.138822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.138822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.138822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.139115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:10.139115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.140365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.146230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 374/752] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:10.146230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.163783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 379/753] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 1 16:27:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:10.164685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.268904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a110-0ffc-459e-98a6-6f03430f06be None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.277711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48332def-81bf-4695-aadc-77ff3f5ce933 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.310362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.311604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.312517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.313287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.314470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:10.315901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.318106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.323811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.324455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.324758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.325030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.342049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 380/754] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:10.342049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.345345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.348567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:10.369241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:10.370238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:10.371119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:10.371119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:10.371119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:10.378202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 375/755] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:10.378202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.380203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.391335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.479470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc91d-809a-43a9-bf8b-a508a7d51861 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.488332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc79a1-9c57-459a-9bcf-6cc3c0947d94 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.524090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.524293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.524910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.525207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.525353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.525748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.525904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.526313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.526738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=4a6f6e719b6f49828fb866b4795e7108) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:10.527149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.528691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.540795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 376/756] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/role_assignments?user.id=4a6f6e719b6f49828fb866b4795e7108&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:10.540795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.653075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.654670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.695974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.721506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.773342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef5886-6948-49dc-bd9d-3add97875342 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.780710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 381/757] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:10.786652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.840109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.840714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.840988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.841256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.841961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:10.842268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.843670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.864453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 377/758] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:10.869771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.980198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0aa0a0-ae60-45c0-b1eb-a679774c185d None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.044410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503c7af-ccc6-409b-91b2-28e27277ece4 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.047732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.048411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.048687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.049504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.057706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.069733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.071203 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:11.086994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:11.088011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:11.088916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:11.088916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:11.088916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:11.088916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 382/759] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:11.093582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.114267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.119793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.120425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.120722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.120986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.133012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.134455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:11.153598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:11.154736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:11.155896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 378/760] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:11.166064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.258494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a34a-9007-4ada-8cd1-6d9d524540e9 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.295332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.296300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.296777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.297262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.298116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:11.299289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.300903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.314008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 383/761] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:11.320975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.345772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0b6c-b9de-4d73-a24a-9d5435caf134 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.389138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ac895-906a-4d6f-ab50-468c46a60b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.390444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac895-906a-4d6f-ab50-468c46a60b12 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.391115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac895-906a-4d6f-ab50-468c46a60b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.391582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac895-906a-4d6f-ab50-468c46a60b12 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.392609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ac895-906a-4d6f-ab50-468c46a60b12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:11.393117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ac895-906a-4d6f-ab50-468c46a60b12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.395020 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ac895-906a-4d6f-ab50-468c46a60b12 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.397986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.412969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 379/762] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:11.414755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75e54-aabf-42d5-9450-8c086f9778c2 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.415263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75e54-aabf-42d5-9450-8c086f9778c2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.415840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75e54-aabf-42d5-9450-8c086f9778c2 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.418288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 380/763] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:11.419185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75e54-aabf-42d5-9450-8c086f9778c2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.453729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173695-0950-414b-bab3-b046f0157166 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.482201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.489549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5dd41-40e9-48e0-920c-f0b50f832db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.490037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5dd41-40e9-48e0-920c-f0b50f832db7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.490401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5dd41-40e9-48e0-920c-f0b50f832db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.490766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5dd41-40e9-48e0-920c-f0b50f832db7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.498138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5dd41-40e9-48e0-920c-f0b50f832db7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.499958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5dd41-40e9-48e0-920c-f0b50f832db7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-bac5dd41-40e9-48e0-920c-f0b50f832db7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:11.511936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:11.512884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:11.513755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 384/764] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:11.515399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b061-a104-4c41-8aaf-6f6931ecb849 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.515784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b061-a104-4c41-8aaf-6f6931ecb849 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.516115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b061-a104-4c41-8aaf-6f6931ecb849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.535886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b851b061-a104-4c41-8aaf-6f6931ecb849 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:11.537210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b851b061-a104-4c41-8aaf-6f6931ecb849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:11.546881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75e54-aabf-42d5-9450-8c086f9778c2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.583733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.584678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.585135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.585583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/1276878b8f0541398e54be24543abd85/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.587790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=1276878b8f0541398e54be24543abd85, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.589455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.607723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 385/765] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:11.608634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b061-a104-4c41-8aaf-6f6931ecb849 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.655318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.681951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 381/766] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:27:11 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/1276878b8f0541398e54be24543abd85/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:27:11.723571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b061-a104-4c41-8aaf-6f6931ecb849 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.762544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.763219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.763498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.763778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.764535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:11.764831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.766308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.781211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 386/767] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:11.787436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.936119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0597e4-89b1-49b5-86dc-4b1e63e0a2d7 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:11.947792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.973779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:11.975281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d388868-7b01-4f9d-8f5d-e31f53702106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:11.975890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d388868-7b01-4f9d-8f5d-e31f53702106 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.976161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d388868-7b01-4f9d-8f5d-e31f53702106 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.976425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d388868-7b01-4f9d-8f5d-e31f53702106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.977448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d388868-7b01-4f9d-8f5d-e31f53702106 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=260ad63e7ce34605a3af952b328fae64) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:11.977753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d388868-7b01-4f9d-8f5d-e31f53702106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:11.984056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d388868-7b01-4f9d-8f5d-e31f53702106 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:11.992174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 382/768] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:11 2022] GET /identity/v3/role_assignments?user.id=260ad63e7ce34605a3af952b328fae64&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:11.994117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1242cc-c63e-4e71-a070-cc63eb5b637a None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.994408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1242cc-c63e-4e71-a070-cc63eb5b637a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.994959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1242cc-c63e-4e71-a070-cc63eb5b637a None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.996652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 383/769] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:12.003204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797148e8-d377-44a4-9c14-56905dfba32f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.003500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797148e8-d377-44a4-9c14-56905dfba32f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.003747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797148e8-d377-44a4-9c14-56905dfba32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.023139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-797148e8-d377-44a4-9c14-56905dfba32f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:12.024552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-797148e8-d377-44a4-9c14-56905dfba32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:12.112738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:12.120163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 384/770] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:12.122596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1a4e-10d9-4211-bb11-8c991910685b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:12.161045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:12.161693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.161968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.162235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.162831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:12.164334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:12.176973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:12.178011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:12.178880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 387/771] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:11 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:12.186234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797148e8-d377-44a4-9c14-56905dfba32f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:12.318915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:12.322594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797148e8-d377-44a4-9c14-56905dfba32f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:12.360798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:12.362085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.362360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.362627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.363280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] RBAC: Adding query filter params (name=network) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:12.363737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:12.365113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:12.370352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 385/772] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:12.376178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:12.465540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:12.516774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855eb8c-23f5-4813-b9cd-b5db080194e9 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:12.583845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:12.584454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.584731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.585006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.585639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:12.585940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:12.587390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:12.594065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 388/773] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:12.600451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:12.639553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:12.677840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b605-6e3e-43a2-a3fb-1795f2c47f47 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:12.748400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:12.748945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.749215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.749478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.750055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:12.751440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:12.765877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:12.766901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:12.768336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:12.771611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 386/774] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Sep 1 16:27:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:12.773721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:12.789019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b661c-8b32-42a8-ba56-75af06358be6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:12.803194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:12.852273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd029612-712d-479b-9ccc-b299083686af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:12.852875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd029612-712d-479b-9ccc-b299083686af None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.853146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd029612-712d-479b-9ccc-b299083686af None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.853413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd029612-712d-479b-9ccc-b299083686af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.854108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd029612-712d-479b-9ccc-b299083686af None admin] RBAC: Adding query filter params (interface=public, service_id=9fcb318c40d24c919eb5682530c1f0b6, region_id=RegionOne) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:12.854409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd029612-712d-479b-9ccc-b299083686af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:12.855785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd029612-712d-479b-9ccc-b299083686af None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:12.874786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 389/775] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:27:12 2022] GET /identity/v3/endpoints?service_id=9fcb318c40d24c919eb5682530c1f0b6&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:12.874786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ca8f5-b6c3-4c25-b782-7d26f63c6759 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.874786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ca8f5-b6c3-4c25-b782-7d26f63c6759 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.874786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ca8f5-b6c3-4c25-b782-7d26f63c6759 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.874786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 390/776] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:12.874786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ca8f5-b6c3-4c25-b782-7d26f63c6759 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:12.894461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b2252-4e63-4377-8a76-2dc99f6beb0a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:12.988579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:13.010196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ca8f5-b6c3-4c25-b782-7d26f63c6759 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:13.041490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaaedf-fff2-477f-a4d4-c3820a750ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:13.042569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaaedf-fff2-477f-a4d4-c3820a750ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.043050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaaedf-fff2-477f-a4d4-c3820a750ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.043582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaaedf-fff2-477f-a4d4-c3820a750ee2 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.044457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaaedf-fff2-477f-a4d4-c3820a750ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:13.046308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaaedf-fff2-477f-a4d4-c3820a750ee2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:13.052412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 391/777] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:12 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:13.059351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:13.059351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.059351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.059351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.059753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:13.059753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:13.060373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:13.061835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a680-2ce1-44a4-b97d-7fda64fdbdcf None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.062320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a680-2ce1-44a4-b97d-7fda64fdbdcf None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.062835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4a680-2ce1-44a4-b97d-7fda64fdbdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.071239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 387/778] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 1 16:27:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:13.072295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:13.096325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-afc4a680-2ce1-44a4-b97d-7fda64fdbdcf None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:13.097964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-afc4a680-2ce1-44a4-b97d-7fda64fdbdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:13.176657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:13.186157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3456c2-9cd5-43eb-a6e4-25d4ebd97db9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:13.224550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:13.225179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.225457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.225730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.226444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:13.226752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:13.228718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:13.235379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 388/779] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 1 16:27:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:13.242546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:13.290755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 392/780] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:13.350259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a0902-e8d6-4b0f-a9b9-5933bfca9b4d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:13.384529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:13.385126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.385400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.385665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.386354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] RBAC: Adding query filter params (interface=public, service_id=da13ba23100c47be8028a9246d85e789, region_id=RegionOne) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:13.386659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:13.388038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:13.396656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 389/781] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:27:13 2022] GET /identity/v3/endpoints?service_id=da13ba23100c47be8028a9246d85e789&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:13.402127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4a680-2ce1-44a4-b97d-7fda64fdbdcf None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:13.485966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:13.501556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4a680-2ce1-44a4-b97d-7fda64fdbdcf None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:13.545204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:13.546521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.546979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.547458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.548272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:13.549846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:13.559621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 393/782] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:13 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:13.602475 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:13.631479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:13.750178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544d92f-4c3f-4064-a7a3-139b562f5c06 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:13.798304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:13.798931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.799242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.799520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.810656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:13.816390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:13.817352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:13.818187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 390/783] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:13.823683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:13.935193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c19e-f6d4-4a71-8299-234ac670e9bb None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:13.974761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd65e4-8f28-41f6-8b85-8be069c4f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:13.975773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd65e4-8f28-41f6-8b85-8be069c4f463 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:13.976253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd65e4-8f28-41f6-8b85-8be069c4f463 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:13.976873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd65e4-8f28-41f6-8b85-8be069c4f463 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:13.977735 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd65e4-8f28-41f6-8b85-8be069c4f463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:13.978234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd65e4-8f28-41f6-8b85-8be069c4f463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:13.979829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd65e4-8f28-41f6-8b85-8be069c4f463 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:13.990368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 394/784] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:13.996237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.090727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.095290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59940c3-f3c2-4b02-acfa-de3620c74e80 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.096112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59940c3-f3c2-4b02-acfa-de3620c74e80 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.096390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59940c3-f3c2-4b02-acfa-de3620c74e80 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.098029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 395/785] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:14.103574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe863a-da03-4348-b561-fb946e593ed1 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.103859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe863a-da03-4348-b561-fb946e593ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.104130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe863a-da03-4348-b561-fb946e593ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.111330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a3139-7433-41c7-9b36-206be901b2d7 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:14.147823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:14.148191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ecbe863a-da03-4348-b561-fb946e593ed1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:14.148452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.148735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.149007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.149361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ecbe863a-da03-4348-b561-fb946e593ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:14.159475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.159724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:14.161275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:14.176843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:14.178036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:14.179090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:14.179090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:14.179090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:14.181646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 391/786] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:14.186423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.264967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 396/787] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:14.322485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b37ec-630e-4229-9684-ef32261d34af None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:14.354733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.364107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7136b51-4a1f-461d-8304-eff192cc99cc None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.364392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7136b51-4a1f-461d-8304-eff192cc99cc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.364628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:14.364751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7136b51-4a1f-461d-8304-eff192cc99cc None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.366894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.366894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.366894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.367139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 397/788] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:14.367243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:14.367243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:14.368086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:14.371796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941001a2-732c-40e5-9837-238ecfd823cb None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.372072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941001a2-732c-40e5-9837-238ecfd823cb None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.372341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941001a2-732c-40e5-9837-238ecfd823cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.393358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 392/789] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:14.402341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.415547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-941001a2-732c-40e5-9837-238ecfd823cb None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:14.416812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-941001a2-732c-40e5-9837-238ecfd823cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:14.512885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9e2b-4770-4ab0-a9ff-6d70fcaf0fbe None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:14.550014 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:14.550640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.550919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.551216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] PATH_INFO: `/v3/users/swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.558765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:14.560255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:14.572341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:14.573322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:14.574285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 393/790] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:14.579232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.613487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 398/791] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:14.614778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941001a2-732c-40e5-9837-238ecfd823cb None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.663852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.735503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.749626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845cb81-3f07-47da-84e2-06e04bf8d3db None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:14.794471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941001a2-732c-40e5-9837-238ecfd823cb None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:14.815584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:14.816205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.816465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.816735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.817466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:14.817769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:14.819229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:14.851470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 394/792] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:14.857059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.862107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:14.862740 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.863020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.863323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.884417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:14.890516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:14.891496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:14.892351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:14.894907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 399/793] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:14.899064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.003886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa34bf-184d-448d-a692-e81fce96e7c1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.022152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.038159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31b602-0c8e-4046-bee1-8119007d97f2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.053912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.055000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.055748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.056321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.070195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.072742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.078161 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.085229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.086547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.087306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.087719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.088520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:15.088962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.090453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:15.093078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:15.094138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:15.095025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:15.095025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:15.095025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:15.095351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 395/794] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:15.096336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.104078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 400/795] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:15.105299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.213223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a60202-b72e-43c2-92c3-1b21f4ff2903 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.218169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c9e8-78b1-4a60-a385-ed9b3e3876a6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.249609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.250336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.255307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.255307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.255307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:15.255307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.255307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.258297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.259304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.259797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.260238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.266602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 401/796] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:15.267568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.273142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:15.279280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:15.280214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:15.281032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:15.288367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 396/797] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:15.289485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.317198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.322915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.373303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ea7f0-59af-49e2-8f0b-21fef8763883 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.411274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.412072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.412620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.412795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.423418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb22a0-be0b-4b85-9cc2-eb3e83fc02c1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.424099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.425661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:15.441466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:15.442649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:15.443781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:15.443781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:15.443781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:15.449717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 402/798] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:15.450854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.474434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.475827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.476376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.477029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.487530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.489479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:15.505589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:15.506782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:15.507912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:15.510610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 397/799] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:15.511696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.572660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46cbaf-5321-4a43-929f-0e8b6eb38032 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.575783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.602055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.609453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.610158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.610452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.610725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.611985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:15.612289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.613771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.626174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 403/800] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:15.626174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.629468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ef47-3797-4b7a-813e-6afc366915a5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.672739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677515-a763-4d39-94e9-0780bfb9ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.673340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677515-a763-4d39-94e9-0780bfb9ac54 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.673659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677515-a763-4d39-94e9-0780bfb9ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.673932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677515-a763-4d39-94e9-0780bfb9ac54 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.674570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677515-a763-4d39-94e9-0780bfb9ac54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:15.674872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677515-a763-4d39-94e9-0780bfb9ac54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.676276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677515-a763-4d39-94e9-0780bfb9ac54 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.688113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 398/801] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:15.689389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16def-bf77-43d4-b5e1-2b66e3fefda9 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.689632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16def-bf77-43d4-b5e1-2b66e3fefda9 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.689907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16def-bf77-43d4-b5e1-2b66e3fefda9 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.691438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 399/802] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:15.692142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16def-bf77-43d4-b5e1-2b66e3fefda9 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.745628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b70e9-d591-46a7-ba3f-f83026e1e074 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.781638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.782522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.783619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.784089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.784977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:15.785353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.786790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.801975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16def-bf77-43d4-b5e1-2b66e3fefda9 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.840161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919e79a-f955-409c-99ae-3db8ef037f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.840853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e79a-f955-409c-99ae-3db8ef037f7b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.841111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e79a-f955-409c-99ae-3db8ef037f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.841341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e79a-f955-409c-99ae-3db8ef037f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.853792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919e79a-f955-409c-99ae-3db8ef037f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:15.855299 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919e79a-f955-409c-99ae-3db8ef037f7b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:15.857552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-1919e79a-f955-409c-99ae-3db8ef037f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:15.871813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:15.874257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:15.875464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:15.875464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:15.875464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:15.875464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 400/803] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:15.875464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd55bd-14fc-4c5f-a6ff-566d0c43bf89 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.875464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd55bd-14fc-4c5f-a6ff-566d0c43bf89 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.875464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd55bd-14fc-4c5f-a6ff-566d0c43bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.895707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-42dd55bd-14fc-4c5f-a6ff-566d0c43bf89 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:15.897187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-42dd55bd-14fc-4c5f-a6ff-566d0c43bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:15.919817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 404/804] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:15.920659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.948992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.968408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 401/805] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:15.969255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd55bd-14fc-4c5f-a6ff-566d0c43bf89 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.030365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc994-92b5-4aa2-9755-61c5aba3ecc3 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.066648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d1235-0358-4512-8ec0-3ee9a5b02bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.067305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d1235-0358-4512-8ec0-3ee9a5b02bde None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.067581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d1235-0358-4512-8ec0-3ee9a5b02bde None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.067850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d1235-0358-4512-8ec0-3ee9a5b02bde None admin] PATH_INFO: `/v3/users/nova` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.073890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd55bd-14fc-4c5f-a6ff-566d0c43bf89 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.074730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d1235-0358-4512-8ec0-3ee9a5b02bde None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.076208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d1235-0358-4512-8ec0-3ee9a5b02bde None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-051d1235-0358-4512-8ec0-3ee9a5b02bde None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:16.089199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:16.090131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:16.091072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 405/806] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:16.091715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19d8b-15ba-4bea-a09e-4462c915e449 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.091715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19d8b-15ba-4bea-a09e-4462c915e449 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.092194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19d8b-15ba-4bea-a09e-4462c915e449 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.093300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 406/807] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:16.096405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19d8b-15ba-4bea-a09e-4462c915e449 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.108024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.119230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.119841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.120121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.120393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.121036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:16.121337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.122701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.134799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 402/808] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:16.135690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.191524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.207206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19d8b-15ba-4bea-a09e-4462c915e449 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.242842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad975a-a04f-4679-bd8f-6a53f55e059a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.247661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.248334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.248594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.248864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/4a6f6e719b6f49828fb866b4795e7108/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.250817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=4a6f6e719b6f49828fb866b4795e7108, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.252333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.275616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb1965-f1f4-4e7c-ae89-e8b39bc9a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.276205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1965-f1f4-4e7c-ae89-e8b39bc9a0cd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.276482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1965-f1f4-4e7c-ae89-e8b39bc9a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.276796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1965-f1f4-4e7c-ae89-e8b39bc9a0cd None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.277518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb1965-f1f4-4e7c-ae89-e8b39bc9a0cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:16.277821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb1965-f1f4-4e7c-ae89-e8b39bc9a0cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.279258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb1965-f1f4-4e7c-ae89-e8b39bc9a0cd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.298320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 403/809] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:16.298320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ea5c-47d8-4633-8fec-45b420ee23de None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.298320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ea5c-47d8-4633-8fec-45b420ee23de None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.298320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16ea5c-47d8-4633-8fec-45b420ee23de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.315422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3c16ea5c-47d8-4633-8fec-45b420ee23de None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:16.316598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3c16ea5c-47d8-4633-8fec-45b420ee23de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:16.333170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 407/810] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:27:16 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/4a6f6e719b6f49828fb866b4795e7108/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:27:16.333981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.354042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.388658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 404/811] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:16.389553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ea5c-47d8-4633-8fec-45b420ee23de None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.478205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a83f9-f711-4488-b860-93c88fed05d6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.512082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16ea5c-47d8-4633-8fec-45b420ee23de None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.523764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.524402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.524678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.524949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.537742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.540210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.550861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.551814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.552265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.552707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] PATH_INFO: `/v3/services/network` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.553463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:16.553809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:16.554718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:16.555691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 408/812] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:16.556270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.562522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.565291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:16.573754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:16.579703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:16.581069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 405/813] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:16.581845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.617143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.691457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153f1e5-698a-433c-bf15-8bec75489050 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.698969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a636-e69f-48f5-8863-c7cd4fb49735 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.730116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.730728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.731004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.731291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.739282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.739985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.740165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.740426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.741148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:16.741450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.742940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.765917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 406/814] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:16.765917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.808297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.810094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.820226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.867904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.874948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06bcb-597c-4fc0-9d6d-1ff6a365e2fd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:16.911548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:16.912267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.912543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.912932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.913562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] RBAC: Adding query filter params (name=network) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:16.913864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.915358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.926758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 409/815] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:16.926758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:16.927005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 407/816] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:16.927005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.025171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdadc-93e9-4520-9f8a-e1c1fc4d85b3 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.026076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8553d-6ded-44f0-8493-47a2a1c43146 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.032265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.060356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.060907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.061184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.061452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.062024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.063440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.067884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.068506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.068812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.069081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:17.073403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:17.074366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:17.080278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 410/817] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:17.081246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.084947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.086697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:17.103458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:17.104616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:17.105709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:17.105709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:17.105709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:17.107218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 408/818] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:17.108196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.121930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.187943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e139-740e-44c2-b5de-2191bf537587 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.222791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.223420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.223696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.223964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.224587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] RBAC: Adding query filter params (type=network) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:17.224884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.226298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.230726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f3e49-4268-402e-ae3c-95cf68f02dae None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.231648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 411/819] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:17.232431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.268334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.273620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.274247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.274522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.275065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.285326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.286822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:17.301947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:17.303073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:17.303993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:17.303993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:17.303993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:17.303993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 409/820] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:17.303993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.343732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e383e0-31a7-43df-b0c2-9157eee051ba None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.379088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.387611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.389278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.389735 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.394014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.394014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:17.394014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.394014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.398823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 412/821] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:17.399860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.428695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f079077-92f9-491f-a393-ed6a0ae93f5a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.472925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.474089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.478473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.478929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.479636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:17.479952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.481674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.500168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 410/822] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:17.500168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.520986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.525567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06273326-af20-49da-8f72-6519acdb7d86 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.562871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.563514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.563891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.564535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.565472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.567015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.607259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728fa2f-e941-4134-bd29-d530930f2616 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.635231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.647683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.648294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.648574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.648900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.649488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:17.649819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.651217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.670022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 411/823] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:17.670953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.691844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 413/824] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:17.692884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.837074 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc95d-f380-422d-b756-7c8530f6328a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.883383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f8b4a-7a3d-4afe-9b30-d23311a1d289 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.885197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.885881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.886230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.886504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.887697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:17.887697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.889724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.899253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 412/825] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:17.900149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.928983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.929624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.929903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.930175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.939443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.940967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:17.953375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:17.954398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:17.955879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 414/826] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:17.956352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.964132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.970981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:18.022360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befc93-59ec-466e-bd9a-9a711ba3384d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:18.058017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:18.058635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.058906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.059351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.061933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b3443-7b4f-4b63-ab8f-949b2e71423e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:18.066707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:18.068175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:18.079501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:18.080434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:18.081338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 413/827] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:18.081869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:18.103951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:18.104560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.104840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.105109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.105774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:18.107130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:18.191347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 415/828] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:18.191347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:18.197341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a81fd-c6db-4e27-9d7f-eebb01227cbd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:18.211969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:18.258297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3baf0-f430-4bb2-bfde-eca115f11349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:18.259228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3baf0-f430-4bb2-bfde-eca115f11349 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.260056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3baf0-f430-4bb2-bfde-eca115f11349 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.260341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3baf0-f430-4bb2-bfde-eca115f11349 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.261069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3baf0-f430-4bb2-bfde-eca115f11349 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:18.261378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3baf0-f430-4bb2-bfde-eca115f11349 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:18.262855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3baf0-f430-4bb2-bfde-eca115f11349 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:18.282088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 414/829] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:18.283549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174fdc-9523-4afb-ad25-c00302e07e69 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.283810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174fdc-9523-4afb-ad25-c00302e07e69 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.292214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174fdc-9523-4afb-ad25-c00302e07e69 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.292214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 415/830] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:18.292433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:18.292539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18174fdc-9523-4afb-ad25-c00302e07e69 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:18.323987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff94f9b-adeb-4740-b6d2-e74172bb7d93 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:18.362550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c18bb4-dfca-47b8-9c22-68c4aaafa24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:18.363147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18bb4-dfca-47b8-9c22-68c4aaafa24a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.363452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18bb4-dfca-47b8-9c22-68c4aaafa24a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.363726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18bb4-dfca-47b8-9c22-68c4aaafa24a None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.364896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18bb4-dfca-47b8-9c22-68c4aaafa24a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:18.364896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18bb4-dfca-47b8-9c22-68c4aaafa24a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:18.366193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18bb4-dfca-47b8-9c22-68c4aaafa24a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:18.380161 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 416/831] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:18.381418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fbcca-59e5-4424-98a3-16e19e741038 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.381698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fbcca-59e5-4424-98a3-16e19e741038 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.381965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fbcca-59e5-4424-98a3-16e19e741038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.400809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-047fbcca-59e5-4424-98a3-16e19e741038 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:18.402008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-047fbcca-59e5-4424-98a3-16e19e741038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:18.413550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18174fdc-9523-4afb-ad25-c00302e07e69 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:18.449419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:18.450177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.450432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.450705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/260ad63e7ce34605a3af952b328fae64/roles/ab121134924143bbb0fc522f9e5a6354` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.465783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=260ad63e7ce34605a3af952b328fae64, role_id=ab121134924143bbb0fc522f9e5a6354)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:18.467265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:18.472903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 417/832] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:18.473710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fbcca-59e5-4424-98a3-16e19e741038 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:18.536612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:18.568055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 416/833] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:27:18 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/260ad63e7ce34605a3af952b328fae64/roles/ab121134924143bbb0fc522f9e5a6354 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:27:18.594347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fbcca-59e5-4424-98a3-16e19e741038 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:18.639672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:18.640710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.641187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.641678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.642697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=1276878b8f0541398e54be24543abd85) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:18.643230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:18.644892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:18.653238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 418/834] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:18 2022] GET /identity/v3/role_assignments?user.id=1276878b8f0541398e54be24543abd85&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:18.762985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:18.779853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:18.868204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57380d5-a1af-436e-9c3e-d68e80a3de50 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:18.904432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:18.905078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.905320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.905582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.916953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:18.921778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:18.922722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:18.924168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:18.927288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 417/835] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:18.929634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:19.037178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28334785-56ef-4749-8e46-77e03e753110 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.062105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:19.076917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.077513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.077786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.078055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.078720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:19.079013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:19.080568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:19.093705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 419/836] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:19.095064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:19.170214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:19.202832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be77741-fbb6-41bc-b168-f9fa313bcc43 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.240337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.241421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.241894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.242404 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.254518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:19.256296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:19.271883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:19.272866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:19.273749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:19.273749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:19.273749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:19.275878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 418/837] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:19.284687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:19.393231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa255c-ae5f-46b4-8fba-17548d25bf62 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.434158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.435062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.435534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.435979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.436813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:19.437288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:19.438818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:19.456496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 420/838] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:19.458173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:19.564820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbef23f-dd06-4703-8992-3454f3a5222d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.590227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:19.602033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.602925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.603571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.609096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.612711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:19.614436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:19.627352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:19.628321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:27:19.629248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:19.636297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 419/839] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:19.637877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:19.685484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:19.748541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a00c-b336-47fa-84aa-65832f74d2c0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.790302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.791454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.791934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.792404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.793326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:19.793830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:19.795484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:19.817967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 421/840] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 1 16:27:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:19.820590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:19.929791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83a3f5-02df-4e8e-a4b6-49ce4737eab6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.966437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0e562-5857-43e6-92ae-a398cb5852da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.967445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e562-5857-43e6-92ae-a398cb5852da None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.967926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e562-5857-43e6-92ae-a398cb5852da None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.968411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e562-5857-43e6-92ae-a398cb5852da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.024545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.042160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0e562-5857-43e6-92ae-a398cb5852da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.047620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0e562-5857-43e6-92ae-a398cb5852da None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.159346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 420/841] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:20.161114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.164049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc126-ebc5-400b-875f-6d1c3fb0c4f1 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.164337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc126-ebc5-400b-875f-6d1c3fb0c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.164613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc126-ebc5-400b-875f-6d1c3fb0c4f1 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.166173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 421/842] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:20.171013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc472-9dfb-42d3-9d6d-c9b141a70b6f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.171342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc472-9dfb-42d3-9d6d-c9b141a70b6f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.171619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc472-9dfb-42d3-9d6d-c9b141a70b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.189844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3ccdc472-9dfb-42d3-9d6d-c9b141a70b6f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:20.190956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3ccdc472-9dfb-42d3-9d6d-c9b141a70b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.267518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 422/843] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:20.287712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.291650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7399e-234c-493c-a906-8429ed0afb73 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.329303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:20.330331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.330807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.331322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.342152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.343907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:20.359168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:20.360101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:20.361557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:20.361557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:20.361557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:20.367265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 422/844] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:20.372227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc472-9dfb-42d3-9d6d-c9b141a70b6f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.389252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.483645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc472-9dfb-42d3-9d6d-c9b141a70b6f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.519394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:20.520350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.520827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.521654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.522493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:20.522992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.524598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.541575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 423/845] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:20.543300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.545232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.628332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.655624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aea22-7eae-4222-8d71-e3d3d3e3ce70 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.656648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720ed60-e13b-4b2c-bed6-924fab54c5e6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.691416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b29f1-4efa-4f8c-aae4-c5d0a0ed7650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:20.692078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b29f1-4efa-4f8c-aae4-c5d0a0ed7650 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.692364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b29f1-4efa-4f8c-aae4-c5d0a0ed7650 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.692632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b29f1-4efa-4f8c-aae4-c5d0a0ed7650 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.693223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b29f1-4efa-4f8c-aae4-c5d0a0ed7650 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.694584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b29f1-4efa-4f8c-aae4-c5d0a0ed7650 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.699518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636df346-cc23-498f-8802-bdba7a03caeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:20.700439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636df346-cc23-498f-8802-bdba7a03caeb None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.700917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636df346-cc23-498f-8802-bdba7a03caeb None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.701379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636df346-cc23-498f-8802-bdba7a03caeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-4c8b29f1-4efa-4f8c-aae4-c5d0a0ed7650 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:20.707087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:20.708337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:20.709191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 424/846] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:20.710868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c153ea0-b058-4945-a339-d042e1283b47 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.710868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c153ea0-b058-4945-a339-d042e1283b47 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.710868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c153ea0-b058-4945-a339-d042e1283b47 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.715555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636df346-cc23-498f-8802-bdba7a03caeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.715707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 425/847] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:20.716474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c153ea0-b058-4945-a339-d042e1283b47 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.717648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636df346-cc23-498f-8802-bdba7a03caeb None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-636df346-cc23-498f-8802-bdba7a03caeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:20.730661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:20.731631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:20.732531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:20.736717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 423/848] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:20.737989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ab18e-91d4-4ca6-b9ad-14f06672b587 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.738273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ab18e-91d4-4ca6-b9ad-14f06672b587 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.738545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ab18e-91d4-4ca6-b9ad-14f06672b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.757685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f18ab18e-91d4-4ca6-b9ad-14f06672b587 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:20.758870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f18ab18e-91d4-4ca6-b9ad-14f06672b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.766173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.820631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c153ea0-b058-4945-a339-d042e1283b47 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.825131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 424/849] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:20.825947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ab18e-91d4-4ca6-b9ad-14f06672b587 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.859404 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827e45-3845-4946-a29b-97e411c29d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:20.860007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827e45-3845-4946-a29b-97e411c29d9a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.860288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827e45-3845-4946-a29b-97e411c29d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.860561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827e45-3845-4946-a29b-97e411c29d9a None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.861216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827e45-3845-4946-a29b-97e411c29d9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:20.861519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827e45-3845-4946-a29b-97e411c29d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.862890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827e45-3845-4946-a29b-97e411c29d9a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.871311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 426/850] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:20.872517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad193a8-3f97-4768-9503-d13c78424c32 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.872801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad193a8-3f97-4768-9503-d13c78424c32 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.873067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad193a8-3f97-4768-9503-d13c78424c32 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.874275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 427/851] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:20.874947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad193a8-3f97-4768-9503-d13c78424c32 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.878373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.940069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ab18e-91d4-4ca6-b9ad-14f06672b587 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.977399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7f9ba-fcf9-4f6a-abed-a8b6f9b51726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:20.978472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7f9ba-fcf9-4f6a-abed-a8b6f9b51726 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.978949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7f9ba-fcf9-4f6a-abed-a8b6f9b51726 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.979443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7f9ba-fcf9-4f6a-abed-a8b6f9b51726 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.980538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7f9ba-fcf9-4f6a-abed-a8b6f9b51726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:20.981168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7f9ba-fcf9-4f6a-abed-a8b6f9b51726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.982708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7f9ba-fcf9-4f6a-abed-a8b6f9b51726 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.984683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad193a8-3f97-4768-9503-d13c78424c32 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.000549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 425/852] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:21.000549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76245-28d6-4028-96db-a583e6e61c70 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.000549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76245-28d6-4028-96db-a583e6e61c70 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.000549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76245-28d6-4028-96db-a583e6e61c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.004988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.018645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d7d76245-28d6-4028-96db-a583e6e61c70 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:21.020017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d7d76245-28d6-4028-96db-a583e6e61c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:21.026192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.027016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.027504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.027956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.029168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:21.029677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.031607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.051185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 428/853] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:21.051185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.109867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 426/854] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:21.110771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76245-28d6-4028-96db-a583e6e61c70 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.144756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.184347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6136-a159-4a98-aeab-a04d770334f4 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.235580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.237344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.237886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.238588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.240176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=4a6f6e719b6f49828fb866b4795e7108) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:21.240701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.241843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76245-28d6-4028-96db-a583e6e61c70 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.242952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.257202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 429/855] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/role_assignments?user.id=4a6f6e719b6f49828fb866b4795e7108&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:21.280663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.288017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.288603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.289167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.289436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.301997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:21.307196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:21.308174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:21.309016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 427/856] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:21.316168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.387539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.457343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a491-2dea-4388-94f0-f6234cc14686 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.492500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.499333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.500027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.500384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.500723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.501821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:21.502142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.503595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.515330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 430/857] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:21.522324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.528378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ca304-2e55-46a3-8d1e-093fafedebf4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.582608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.584198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.584702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.585404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.586194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.588676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:21.601439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:21.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:21.603366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:21.605526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 428/858] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:21.612480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.641080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb6ade-4c73-4ec5-986d-d2f18967cd4b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.686856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.687941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.687941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.688157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.692493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.698956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.700582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:21.717604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:21.718635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:21.719573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:21.719573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:21.719573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:21.723663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 431/859] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:21.724916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.750133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d0eeb-04a0-462e-8cd0-a9d1c91b34f5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.781977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.791248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.796932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.796932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.796932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.796932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:21.796932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.796932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.803814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 429/860] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:21.809222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.841483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45795948-d98d-476f-aefc-42be63d8214f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.877765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.878668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.879217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.879668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.880598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:21.881077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.882723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.900920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 432/861] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:21.902543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:21.918297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597e1a6-6034-427d-8a39-8d739b5571bf None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:21.940659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.956295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.956984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.957430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.957773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.958471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:21.958839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.960296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.976720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 430/862] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:22.025338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa6d54-9c98-4350-aea4-285f89156608 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:22.027943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.065466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:22.066024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.066306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.066577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.074914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:22.077032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:22.090742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:22.091803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:22.092953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 433/863] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:27:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:22.103994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:22.213237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fa76b-c71c-41c5-90c0-379f98ad4889 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:22.249728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:22.250484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.250660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.250858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.251657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:22.251964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:22.253399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:22.271886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 431/864] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 1 16:27:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:22.277695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:22.383041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcffb54-9849-4e87-a453-6fbab2a42eee None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:22.418582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:22.419214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.419493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.419767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.452788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.493846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:22.495337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:22.598578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 434/865] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:22.604483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:22.660746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.721248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ec42-6b59-419e-9ab6-6ad3770d0374 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:22.762109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:22.762750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.763029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.763333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.774339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:22.775814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:22.791464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:22.792431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:22.793815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:22.793815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:22.793815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:22.793815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 432/866] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:22.800342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:22.864902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.903714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5689-a542-4a0a-950d-1a528adfbc3c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:22.939049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b798e-8c66-4e29-bbff-047eb8c85d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:22.939686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b798e-8c66-4e29-bbff-047eb8c85d82 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.939967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b798e-8c66-4e29-bbff-047eb8c85d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.940239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b798e-8c66-4e29-bbff-047eb8c85d82 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.940881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b798e-8c66-4e29-bbff-047eb8c85d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:22.941183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b798e-8c66-4e29-bbff-047eb8c85d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:22.942606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b798e-8c66-4e29-bbff-047eb8c85d82 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:22.955005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 435/867] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:22.963376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:23.009980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7eb26-e129-4bea-b0b0-4f066b512631 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.010332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7eb26-e129-4bea-b0b0-4f066b512631 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.010900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7eb26-e129-4bea-b0b0-4f066b512631 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.012990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 436/868] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:23.018926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdaf20-5135-44a2-9e07-22309de14b1a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.019500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdaf20-5135-44a2-9e07-22309de14b1a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.019790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdaf20-5135-44a2-9e07-22309de14b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.042686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9ecdaf20-5135-44a2-9e07-22309de14b1a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:23.044834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9ecdaf20-5135-44a2-9e07-22309de14b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:23.077042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:23.086307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c1e1b-e295-4124-aaf3-c2e857b0b65a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:23.120902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 437/869] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:23.135146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1bf55-23fa-432b-9c59-fb085c26f071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:23.135845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1bf55-23fa-432b-9c59-fb085c26f071 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.136124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1bf55-23fa-432b-9c59-fb085c26f071 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.136389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1bf55-23fa-432b-9c59-fb085c26f071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.144310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1bf55-23fa-432b-9c59-fb085c26f071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:23.145733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1bf55-23fa-432b-9c59-fb085c26f071 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-d1a1bf55-23fa-432b-9c59-fb085c26f071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:23.157482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:23.158970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:23.159890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:23.163481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 433/870] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:23.165532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdaf20-5135-44a2-9e07-22309de14b1a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:23.225702 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:23.273613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdaf20-5135-44a2-9e07-22309de14b1a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:23.309064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:23.309669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.309945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.310215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.310964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:23.311306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:23.312789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:23.321104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ac87-9a67-4602-a206-56cffe9932a6 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.321577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ac87-9a67-4602-a206-56cffe9932a6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.321656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ac87-9a67-4602-a206-56cffe9932a6 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.323075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 434/871] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:23.331241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d452-73c4-4350-81e3-ba8d23cd56ae None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.331241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d452-73c4-4350-81e3-ba8d23cd56ae None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.331241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d452-73c4-4350-81e3-ba8d23cd56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.332960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 438/872] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:23.337455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:23.351537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-cbf7d452-73c4-4350-81e3-ba8d23cd56ae None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:23.353721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cbf7d452-73c4-4350-81e3-ba8d23cd56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:23.434292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 435/873] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:23.435534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7d452-73c4-4350-81e3-ba8d23cd56ae None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:23.465823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59902-9888-414f-b6db-36457717c1c2 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:23.499578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:23.511731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:23.515859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.516142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.516419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.518233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=260ad63e7ce34605a3af952b328fae64) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:23.518550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:23.520478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:23.528319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:23.529644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 439/874] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:23 2022] GET /identity/v3/role_assignments?user.id=260ad63e7ce34605a3af952b328fae64&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:23.552520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7d452-73c4-4350-81e3-ba8d23cd56ae None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:23.591426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:23.592449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.592944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.593444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.594314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:23.596496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:23.668936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 436/875] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:23 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:23.716605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:23.838593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88177c-0b85-4345-a347-210c441d36c5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:23.880791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a414e-88aa-428e-8666-8059228db05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:23.881837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a414e-88aa-428e-8666-8059228db05b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.882348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a414e-88aa-428e-8666-8059228db05b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.882815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a414e-88aa-428e-8666-8059228db05b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.883634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a414e-88aa-428e-8666-8059228db05b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:23.885256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a414e-88aa-428e-8666-8059228db05b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-1f9a414e-88aa-428e-8666-8059228db05b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:23.895259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:23.896552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:23.897411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:23.898153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 440/876] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:23.904269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:24.012449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fbe3d-84ce-429c-8805-406a1bacbcff None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:24.047618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89ee2-4678-46c9-9a12-2426bd23ac69 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:24.048703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89ee2-4678-46c9-9a12-2426bd23ac69 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:24.048703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89ee2-4678-46c9-9a12-2426bd23ac69 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:24.050879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 441/877] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:24.051137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:24.052061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:24.052553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:24.053038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:24.053930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:24.054519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:24.055894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba481614-9515-499b-b319-a63920c45560 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:24.056174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba481614-9515-499b-b319-a63920c45560 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:24.056440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba481614-9515-499b-b319-a63920c45560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:24.056748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:24.062771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 437/878] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:24.070352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:24.076465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ba481614-9515-499b-b319-a63920c45560 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:24.077685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ba481614-9515-499b-b319-a63920c45560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:24.083717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:24.124293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:24.175138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 442/879] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:24.180356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb5d2a-6cb0-499d-9fc1-bf74043873b5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:24.215699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190bad1-c4e8-400a-8414-7a1c8d787e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:24.216643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bad1-c4e8-400a-8414-7a1c8d787e92 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:24.217120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bad1-c4e8-400a-8414-7a1c8d787e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:24.217556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bad1-c4e8-400a-8414-7a1c8d787e92 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:24.218343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190bad1-c4e8-400a-8414-7a1c8d787e92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:24.218873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190bad1-c4e8-400a-8414-7a1c8d787e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:24.221093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190bad1-c4e8-400a-8414-7a1c8d787e92 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:24.225929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 438/880] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:24.448572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba481614-9515-499b-b319-a63920c45560 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:24.552491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba481614-9515-499b-b319-a63920c45560 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:24.587769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d7c6-84c1-4fe4-ad51-564f27ee4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:24.588372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d7c6-84c1-4fe4-ad51-564f27ee4e37 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:24.588645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d7c6-84c1-4fe4-ad51-564f27ee4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:24.588915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d7c6-84c1-4fe4-ad51-564f27ee4e37 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:24.589566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d7c6-84c1-4fe4-ad51-564f27ee4e37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:24.590920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d7c6-84c1-4fe4-ad51-564f27ee4e37 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:24.711991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 443/881] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:24 2022] POST /identity/v3/services => generated 269 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:25.596589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5c03-1cb8-4c44-9a33-3e699ee3d93c None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:25.597619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5c03-1cb8-4c44-9a33-3e699ee3d93c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:25.598130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5c03-1cb8-4c44-9a33-3e699ee3d93c None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.599975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 439/882] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:25.605360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915070-d74e-42be-8b33-b780690ef744 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:25.606170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915070-d74e-42be-8b33-b780690ef744 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:25.606642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3915070-d74e-42be-8b33-b780690ef744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.625707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-e3915070-d74e-42be-8b33-b780690ef744 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:25.627003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e3915070-d74e-42be-8b33-b780690ef744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:25.652082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:25.714548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 444/883] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:25.745884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2941-ff81-4549-ab91-dc290766bb33 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:25.746217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2941-ff81-4549-ab91-dc290766bb33 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:25.746433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd2941-ff81-4549-ab91-dc290766bb33 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.748079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 440/884] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:25.753382 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3f2e-d41c-4616-9edf-45d4565cb69e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:25.753664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3f2e-d41c-4616-9edf-45d4565cb69e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:25.753928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3f2e-d41c-4616-9edf-45d4565cb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.772780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-aebd3f2e-d41c-4616-9edf-45d4565cb69e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:25.773962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-aebd3f2e-d41c-4616-9edf-45d4565cb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:25.842621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 445/885] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:25.988349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2941-ff81-4549-ab91-dc290766bb33 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.061932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.093374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd2941-ff81-4549-ab91-dc290766bb33 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.111734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3f2e-d41c-4616-9edf-45d4565cb69e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.136349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.137016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.137303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.137572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.153377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:26.159300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:26.160277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:26.161132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 441/886] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 1 16:27:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:26.166372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.221100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.238300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3f2e-d41c-4616-9edf-45d4565cb69e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.277335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d013a7-ab49-4dd9-854c-bc2cc9e6b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.277967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f93566-43c4-4627-86c7-c9fe2101455f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.278541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d013a7-ab49-4dd9-854c-bc2cc9e6b65f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.279025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d013a7-ab49-4dd9-854c-bc2cc9e6b65f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.279607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d013a7-ab49-4dd9-854c-bc2cc9e6b65f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.280558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d013a7-ab49-4dd9-854c-bc2cc9e6b65f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.282192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d013a7-ab49-4dd9-854c-bc2cc9e6b65f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-24d013a7-ab49-4dd9-854c-bc2cc9e6b65f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:26.292733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:26.293959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:26.294894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 446/887] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:26.295855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8efe7-6972-4ef1-b80c-04dbe920b920 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.295855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8efe7-6972-4ef1-b80c-04dbe920b920 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.296067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8efe7-6972-4ef1-b80c-04dbe920b920 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.297591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 447/888] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:26.302490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8efe7-6972-4ef1-b80c-04dbe920b920 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.313253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.318303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ed6ac-5d71-4662-b545-be655849b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.318913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed6ac-5d71-4662-b545-be655849b09e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.319215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed6ac-5d71-4662-b545-be655849b09e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.319492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed6ac-5d71-4662-b545-be655849b09e None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.320225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ed6ac-5d71-4662-b545-be655849b09e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:26.320521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ed6ac-5d71-4662-b545-be655849b09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.321883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ed6ac-5d71-4662-b545-be655849b09e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.335320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 442/889] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:26.335320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626734d-2421-46fe-a377-afa54517a2ac None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.335320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626734d-2421-46fe-a377-afa54517a2ac None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.335320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626734d-2421-46fe-a377-afa54517a2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.350059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8626734d-2421-46fe-a377-afa54517a2ac None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:26.351273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8626734d-2421-46fe-a377-afa54517a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:26.418271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 443/890] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:26.418933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626734d-2421-46fe-a377-afa54517a2ac None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.429312 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8efe7-6972-4ef1-b80c-04dbe920b920 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.468965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.470006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.470970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.471545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.472548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:26.473079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.474647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.480818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 448/891] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:26.486094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.505334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.547137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626734d-2421-46fe-a377-afa54517a2ac None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.581224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.597514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.599017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.599964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.600411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.615142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.616498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41115153-79bc-4ad9-9434-534db95833b0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.617356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:26.637564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:26.638724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:26.639850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:26.639850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:26.639850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:26.642703 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 444/892] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:26.648244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.668990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.670268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.670985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.671464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.672437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:26.672941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.674834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.681943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 449/893] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:26.687546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.763120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0c8a-0041-43c0-b3dc-b672d81e89f3 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.766826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.790605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b717b4b-0da1-4d4e-87b9-80595dc2ea5d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.799824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.800371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.800646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.802039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.802555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:26.802820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.804220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.817900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 445/894] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:26.817900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.829030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46307e3d-5ed5-4a27-98eb-41d74f946aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.829664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307e3d-5ed5-4a27-98eb-41d74f946aad None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.829942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307e3d-5ed5-4a27-98eb-41d74f946aad None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.830217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307e3d-5ed5-4a27-98eb-41d74f946aad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.830920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46307e3d-5ed5-4a27-98eb-41d74f946aad None admin] RBAC: Adding query filter params (interface=public, service_id=b5a5b946dbf346ba9ded40faffd56912, region_id=RegionOne) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:26.831262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46307e3d-5ed5-4a27-98eb-41d74f946aad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.832628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46307e3d-5ed5-4a27-98eb-41d74f946aad None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.837480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 450/895] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/endpoints?service_id=b5a5b946dbf346ba9ded40faffd56912&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:26.838605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fffba6-4601-4435-ab14-bb7c635a3ba7 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.838889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fffba6-4601-4435-ab14-bb7c635a3ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.839182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fffba6-4601-4435-ab14-bb7c635a3ba7 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.840373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 451/896] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:26.841066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fffba6-4601-4435-ab14-bb7c635a3ba7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.855978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.919274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5e3f-073b-4cf7-a32b-2ddc86a72eb8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.941811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fffba6-4601-4435-ab14-bb7c635a3ba7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.952950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05419c91-e769-471a-b7cd-d59960af0bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.953554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419c91-e769-471a-b7cd-d59960af0bd3 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.953830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419c91-e769-471a-b7cd-d59960af0bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.954100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419c91-e769-471a-b7cd-d59960af0bd3 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.955375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05419c91-e769-471a-b7cd-d59960af0bd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.956738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05419c91-e769-471a-b7cd-d59960af0bd3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.976211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.976835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.977113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.977382 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.984753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.986212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.988729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:26.997286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:26.998218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 452/897] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:26.999169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.043082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 446/898] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:26 2022] POST /identity/v3/services => generated 241 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:27.044515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153dfa9-ebd2-47f9-9927-46f966405678 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.044891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153dfa9-ebd2-47f9-9927-46f966405678 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.045242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153dfa9-ebd2-47f9-9927-46f966405678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.066952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4153dfa9-ebd2-47f9-9927-46f966405678 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:27.068276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4153dfa9-ebd2-47f9-9927-46f966405678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:27.106921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364c749-d61e-4987-bdda-c36b7689aae1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.150041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:27.150285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 447/899] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:27.150651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.150981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.151277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.151891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:27.152178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153dfa9-ebd2-47f9-9927-46f966405678 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.153293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:27.168390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 453/900] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:27:27.184647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:27.277868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153dfa9-ebd2-47f9-9927-46f966405678 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.317727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:27.318277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.318557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.318828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.319602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:27.319905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:27.321332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:27.339767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 448/901] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:27.345950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.412777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:27.430053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.460512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ddfef-1163-45a0-9e93-9984c06cfe1a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.511645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:27.513429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.513896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.514348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.524566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:27.545836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad8f82-2462-4c29-946c-4b2a623440a8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.598394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:27.599931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.600207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.600474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.601058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:27.603391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:27.610276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:27.612167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:27.613046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:27.613970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:27.614867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:27.619280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 449/902] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:27.620775 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.702093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:27.748581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef0e9-70dc-42c7-8c77-dcda16794fcd None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.754439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 454/903] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:27.755487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.799546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:27.800813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.801245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.801919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.802694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:27.803438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:27.805553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:27.812226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 450/904] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:27.818573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.833908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:27.862340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88340-8d85-474c-8497-b18a3ea11450 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.900746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:27.901512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.901891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.902493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.916079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:27.918497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:27.937890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:27.939471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:27.940344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:27.940344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:27.940344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:27.943218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 455/905] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:27.945520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.959325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952229-04df-4ed6-9e89-9d5ac938ade7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.966050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:28.005501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:28.006109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:28.006391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:28.006665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:28.007325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:28.007630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:28.009738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:28.015923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 451/906] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:28.021687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:28.087780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63480d0-9831-473e-ab50-6fa4b3b397aa None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:28.096430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:28.128289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:28.128937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:28.129212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:28.129585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:28.130454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:28.130614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:28.132416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:28.134125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa302c9-99ba-4f54-8354-1655a4e05609 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:28.150808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 456/907] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:28.151948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:28.179538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:28.181194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:28.181477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:28.181748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:28.182490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] RBAC: Adding query filter params (interface=public, service_id=d336e8a773f94a1587ce4322e8160c8d, region_id=RegionOne) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:28.182753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:28.184249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:28.190312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 452/908] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:27:28 2022] GET /identity/v3/endpoints?service_id=d336e8a773f94a1587ce4322e8160c8d&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:28.196348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:28.241117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:28.278249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15bebb-45d5-472a-bc11-1f2caf764aae None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:28.322274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:28.323582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:28.324532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:28.325328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:28.330606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1387b6-202f-408f-9c44-2d4bc5536cf5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:28.337118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:28.339785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:28.357185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:28.358104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:28.359012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:28.365432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 457/909] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:28.366175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:28.375262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:28.375870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:28.376777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:28.377098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:28.377718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:28.379451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:28.381216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:28.386069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 453/910] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:28 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:27:28.492811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f394c-714c-42f0-a4dc-968d54f1ac03 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:28.526621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:28.532243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1de8bc-9b72-4d66-a8d0-bf74f6e84d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:28.533603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1de8bc-9b72-4d66-a8d0-bf74f6e84d87 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:28.534046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1de8bc-9b72-4d66-a8d0-bf74f6e84d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:28.534484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1de8bc-9b72-4d66-a8d0-bf74f6e84d87 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:28.535365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1de8bc-9b72-4d66-a8d0-bf74f6e84d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:28.535869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1de8bc-9b72-4d66-a8d0-bf74f6e84d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:28.537499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1de8bc-9b72-4d66-a8d0-bf74f6e84d87 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:28.550106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 458/911] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:28.556375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:28.675309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd014e-0bfb-4d12-9599-1a610ed8185a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:28.710383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad2a34-6b39-475c-8c89-5e3f553dbcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:28.710983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2a34-6b39-475c-8c89-5e3f553dbcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:28.711365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2a34-6b39-475c-8c89-5e3f553dbcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:28.711636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2a34-6b39-475c-8c89-5e3f553dbcd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:28.712360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad2a34-6b39-475c-8c89-5e3f553dbcd0 None admin] RBAC: Adding query filter params (role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=260ad63e7ce34605a3af952b328fae64) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:28.712666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad2a34-6b39-475c-8c89-5e3f553dbcd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:28.714087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad2a34-6b39-475c-8c89-5e3f553dbcd0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:28.720165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 454/912] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:28 2022] GET /identity/v3/role_assignments?user.id=260ad63e7ce34605a3af952b328fae64&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:29.054483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9217-d07c-49a0-bbaf-732498420c1a None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.055020 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9217-d07c-49a0-bbaf-732498420c1a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.055020 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9217-d07c-49a0-bbaf-732498420c1a None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.056519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 459/913] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:29.061829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668c47-9ecf-4f7c-a223-9f930fbd5fa7 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.062361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668c47-9ecf-4f7c-a223-9f930fbd5fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.062828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668c47-9ecf-4f7c-a223-9f930fbd5fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.081258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f4668c47-9ecf-4f7c-a223-9f930fbd5fa7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:29.082770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f4668c47-9ecf-4f7c-a223-9f930fbd5fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:29.146997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:29.156183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 455/914] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:29.199934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5270-3252-46b1-84c3-c95e32ccdd4c None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.200212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5270-3252-46b1-84c3-c95e32ccdd4c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.200481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5270-3252-46b1-84c3-c95e32ccdd4c None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.202075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 460/915] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:29.207662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c25b-6b37-4169-a01e-69ebe58cd2bd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.207952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c25b-6b37-4169-a01e-69ebe58cd2bd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.208226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c25b-6b37-4169-a01e-69ebe58cd2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.227107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5189c25b-6b37-4169-a01e-69ebe58cd2bd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:29.228418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5189c25b-6b37-4169-a01e-69ebe58cd2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:29.297704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 456/916] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:29.424906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5270-3252-46b1-84c3-c95e32ccdd4c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:29.526431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5270-3252-46b1-84c3-c95e32ccdd4c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:29.561540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:29.562524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.562994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.564017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.564806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:29.566348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:29.575326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:29.576310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:29.577178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:29.579647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c25b-6b37-4169-a01e-69ebe58cd2bd None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:29.580167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 461/917] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:29.586110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:29.647423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:29.704784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c25b-6b37-4169-a01e-69ebe58cd2bd None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:29.711900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce79680-9014-45c7-a9f8-ff79350da2a2 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:29.739518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:29.747924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:29.748811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.749537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.749833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.750680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:29.752659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:29.755515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:29.756521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.756884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.757222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.757924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:29.758290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:29.759791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:29.762164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:29.763107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:29.763968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 457/918] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:29.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 462/919] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:29.772264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:29.772458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:29.890795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c9333-1fa9-4009-9302-8064daa185cd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:29.895788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bdf22-bdcc-4fff-ad3c-43cfb64664af None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:29.916903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:29.930226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:29.930973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.931433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.931801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.932521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:29.932919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:29.934369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:29.937461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:29.938354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.938827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.939268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.940075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 458/920] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:29.940272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:29.940797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:29.942223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:29.947204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:29.952041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 463/921] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:29.957951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:30.023218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:30.065329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2111c-e3e2-4d4f-a9cf-1c834eb0f342 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:30.087370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed86850-bae7-4f21-aadc-f6c68e4efeb6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:30.103442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:30.104445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.105013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.105474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.106365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] RBAC: Adding query filter params (interface=public, service_id=9d7527cd815044c7b1c94a8aad775161, region_id=RegionOne) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:30.106877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:30.108737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:30.122284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 464/922] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/endpoints?service_id=9d7527cd815044c7b1c94a8aad775161&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:30.123565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:30.127527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:30.129067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.129345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.129623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.130262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:30.130566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:30.131977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:30.138922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 459/923] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:30.145157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:30.186841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:30.241380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b85b3-3099-46e2-b102-0f09760006f6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:30.278141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e9c8b-ba53-486b-8f8a-d0ea2fe8b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:30.279053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9c8b-ba53-486b-8f8a-d0ea2fe8b9aa None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.279053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9c8b-ba53-486b-8f8a-d0ea2fe8b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.279487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e9c8b-ba53-486b-8f8a-d0ea2fe8b9aa None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.280289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e9c8b-ba53-486b-8f8a-d0ea2fe8b9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:30.281607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e9c8b-ba53-486b-8f8a-d0ea2fe8b9aa None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:30.287315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61dbb8-c701-485a-aa49-f364c6407d0c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:30.294849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 465/924] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:30 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:27:30.307070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:30.327892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa0f54-fbcb-462e-ae41-0896ad38626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:30.328874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa0f54-fbcb-462e-ae41-0896ad38626e None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.329387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa0f54-fbcb-462e-ae41-0896ad38626e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.329886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa0f54-fbcb-462e-ae41-0896ad38626e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.330770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa0f54-fbcb-462e-ae41-0896ad38626e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:30.332420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa0f54-fbcb-462e-ae41-0896ad38626e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:30.415476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 460/925] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:27:30.480199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58d878-fa55-446a-8da4-5906faf15c7e None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.480565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58d878-fa55-446a-8da4-5906faf15c7e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.480847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58d878-fa55-446a-8da4-5906faf15c7e None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.482507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 466/926] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:30.487869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01131a-6bbc-48e3-8e97-b5fc88730d1c None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.488152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01131a-6bbc-48e3-8e97-b5fc88730d1c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.488427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01131a-6bbc-48e3-8e97-b5fc88730d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.508257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0b01131a-6bbc-48e3-8e97-b5fc88730d1c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:30.509395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0b01131a-6bbc-48e3-8e97-b5fc88730d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:30.590280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 461/927] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:30.728488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f685-aa2c-4eaa-8900-d1c82b5a35e3 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.728817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f685-aa2c-4eaa-8900-d1c82b5a35e3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.729029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f685-aa2c-4eaa-8900-d1c82b5a35e3 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.730682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 467/928] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:30.736364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27e3c5-eef9-47eb-a172-d6d1408dd7f4 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:30.736805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27e3c5-eef9-47eb-a172-d6d1408dd7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:30.737066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27e3c5-eef9-47eb-a172-d6d1408dd7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:30.756410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4e27e3c5-eef9-47eb-a172-d6d1408dd7f4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:30.757599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4e27e3c5-eef9-47eb-a172-d6d1408dd7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:30.828127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 462/929] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:30.886699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f685-aa2c-4eaa-8900-d1c82b5a35e3 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:30.997668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f685-aa2c-4eaa-8900-d1c82b5a35e3 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.011317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:31.033476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.034395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.034875 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.035406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.036198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:31.037765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:31.047370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:31.048867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:27:31.049760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:31.056976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 468/930] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Sep 1 16:27:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:31.058523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27e3c5-eef9-47eb-a172-d6d1408dd7f4 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.091634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:31.099966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.182569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27e3c5-eef9-47eb-a172-d6d1408dd7f4 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.207845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f32a-d511-4159-aee8-9efb9ab33942 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.228350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.229107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.229487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.230377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.231123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:31.231588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:31.233361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:31.243238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 463/931] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:31.247052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.251002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.254067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.254067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.254067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.263616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:31.269000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:31.269937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:31.270801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:31.273418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 469/932] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 1 16:27:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:31.283207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.330230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:31.363605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:31.383204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714efc87-e2c7-4306-989e-a0601f70e578 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.405230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772b42-8668-42a2-8e21-ce4d4e49f28b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.421214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.422074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.422518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.423515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.424384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:31.424911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:31.426581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:31.433233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 464/933] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:31.440699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.448933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.449621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.449967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.450722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.451187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:31.451602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:31.453205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:31.464097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 470/934] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 1 16:27:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:31.469211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.554386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eff8c-45a0-47f3-ad1b-edb8093bb313 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.598320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.598936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.599239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.599514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.600523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:31.602175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:31.608201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:31.612278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83305c-be7c-437f-8cae-88f542fc84e5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.653202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.654233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.654735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.655218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.666344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:31.667813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:31.678699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 465/935] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:31.693060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:31.694107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:31.695251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:31.695251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:31.695251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:31.695251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 471/936] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:31.701841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.720725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:31.825426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a726df1-ee6e-4516-92bd-5f3150a02eac None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:31.864806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:31.865413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:31.865688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:31.865951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:31.866598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:31.866945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:31.868471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:31.883091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 466/937] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:31.888682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:31.993052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd68ff3-6bac-41f3-aec6-50a5088863ca None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.028163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:32.028851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.029126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.029393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.037733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:32.039330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:32.051727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:32.052720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:32.053685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 472/938] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:27:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:32.060600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:32.132210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:32.167921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce144ff3-ff32-4c06-bb85-c80efe72f53b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.204975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c89df-3e68-4f29-a46d-667b64732298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:32.205947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c89df-3e68-4f29-a46d-667b64732298 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.206498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c89df-3e68-4f29-a46d-667b64732298 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.206978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c89df-3e68-4f29-a46d-667b64732298 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.207994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c89df-3e68-4f29-a46d-667b64732298 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:32.208513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c89df-3e68-4f29-a46d-667b64732298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:32.210202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c89df-3e68-4f29-a46d-667b64732298 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:32.229608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 467/939] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 1 16:27:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:32.236101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:32.250389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:32.291932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6d41-f956-4d04-a48a-ea10fc9e41c2 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.292295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6d41-f956-4d04-a48a-ea10fc9e41c2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.292621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6d41-f956-4d04-a48a-ea10fc9e41c2 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.297420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 468/940] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:32.299510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bba8a-9227-405b-a932-5c2c47b2c43a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.299792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bba8a-9227-405b-a932-5c2c47b2c43a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.300060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bba8a-9227-405b-a932-5c2c47b2c43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.321660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5f8bba8a-9227-405b-a932-5c2c47b2c43a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:32.322877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5f8bba8a-9227-405b-a932-5c2c47b2c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:32.367275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce097d-0d28-4267-b34c-bd527382b421 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.403196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 469/941] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:32.409218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e47d-9eca-401f-93e1-5f536e6a7e60 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.409394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e47d-9eca-401f-93e1-5f536e6a7e60 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.409562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e47d-9eca-401f-93e1-5f536e6a7e60 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.414607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 470/942] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:32.414929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:32.415728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd7ba-0b2f-4534-ab39-13f4c440da92 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.415957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.416070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd7ba-0b2f-4534-ab39-13f4c440da92 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.416265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd7ba-0b2f-4534-ab39-13f4c440da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.416684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.417100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.431254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:32.432941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:32.435608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5e0bd7ba-0b2f-4534-ab39-13f4c440da92 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:32.437157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5e0bd7ba-0b2f-4534-ab39-13f4c440da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:32.449147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:32.450323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:32.451440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:32.451440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:32.451440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:32.453309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 473/943] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:32.461701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:32.504364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:32.525150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:32.535505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 471/944] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:32.566770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8bda9-c325-4cab-81ce-5399a64a0dba None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.606493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:32.607132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.607437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.607708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.608344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:32.608646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:32.610071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:32.623120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 474/945] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:32.629268 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd7ba-0b2f-4534-ab39-13f4c440da92 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:32.680751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:32.738438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd7ba-0b2f-4534-ab39-13f4c440da92 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.777605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:32.778597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.779106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.779626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.787370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:32.789116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:32.798617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed87f2-5319-4367-84da-497608f48217 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:32.801302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:32.802271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:32.803273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 472/946] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:32.807927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:32.826910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:32.842274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:32.842920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.843227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.843504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.844357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:32.846604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:32.858993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:32.860369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:32.861348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:32.863308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 475/947] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:32.864133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:32.870278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:32.930280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b526096-6dea-4106-b73e-cd000523ddb3 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.968151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:32.968755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:32.969187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:32.969465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:32.970756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:32.971064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:32.972554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad752fb8-500a-4c5f-a822-4f0ae4c3d9df None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:32.972664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:32.986315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 473/948] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:32.987573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:33.014649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:33.015297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.015626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.015890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.016561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:33.018021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:33.020877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING keystone.server.flask.common [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:27:33.065106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.sql.core [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:27:33.065106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:27:33.065106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [parameters: {'id': 'd451e6f1baf0452480b3ed81af8cf727', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:27:33.065106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81831) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d451e6f1baf0452480b3ed81af8cf727.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d451e6f1baf0452480b3ed81af8cf727. Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:27:33.073198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result.read() Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 16:27:33.073984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application yield resource Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise self.value Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application session.commit() Sep 01 16:27:33.075041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:27:33.076699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:27:33.077619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application result.read() Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:27:33.080631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [parameters: {'id': 'd451e6f1baf0452480b3ed81af8cf727', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:33.082772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:33.084749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d451e6f1baf0452480b3ed81af8cf727. Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 476/949] 10.222.0.69 () {60 vars in 1140 bytes} [Thu Sep 1 16:27:32 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:33.087375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:33.098190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47859f-7eb3-4174-8b63-001a23762c57 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:33.108372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:33.122092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:33.136310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:33.136965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.137246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.137540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.138199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:33.138500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:33.139883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:33.149482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 474/950] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:33.150418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:33.181797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b101daa-8e59-4413-87b5-b25632299c02 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:33.217843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:33.219225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.219543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.219817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/260ad63e7ce34605a3af952b328fae64/roles/8ff9dd1a3c8e4d699dbdfa73ce6a3107` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.222149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=260ad63e7ce34605a3af952b328fae64, role_id=8ff9dd1a3c8e4d699dbdfa73ce6a3107)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:33.223909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:33.264653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906d78-1e49-4a5c-a5c5-729dfb72f0b0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:33.300311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:33.300965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.301243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.301514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.311383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 477/951] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:27:33 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/260ad63e7ce34605a3af952b328fae64/roles/8ff9dd1a3c8e4d699dbdfa73ce6a3107 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:27:33.311383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:33.312040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:33.312040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:33.330233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:33.331443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:33.332577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 475/952] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:33.339431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:33.381806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:33.431807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a91926-6476-4f08-a524-ccafe398167c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:33.434357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:33.474576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:33.475235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.475498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.475768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.476400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:33.476737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:33.478227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:33.487123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36e6f6-c486-4918-892d-426cf5a85982 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:33.487328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 478/953] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:33.496017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:33.535917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e216f0-a987-4483-94f8-33061d40b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:33.536947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e216f0-a987-4483-94f8-33061d40b96a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.537428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e216f0-a987-4483-94f8-33061d40b96a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.537932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e216f0-a987-4483-94f8-33061d40b96a None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.538830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e216f0-a987-4483-94f8-33061d40b96a None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:33.539369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e216f0-a987-4483-94f8-33061d40b96a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:33.541559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e216f0-a987-4483-94f8-33061d40b96a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:33.561948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 476/954] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:33.612209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3be83f-46c1-4507-a870-1f4a9f7b5695 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:33.653434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e5302-caf6-4f17-979a-70965cb7dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:33.654292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e5302-caf6-4f17-979a-70965cb7dbe3 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.654774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e5302-caf6-4f17-979a-70965cb7dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.655324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e5302-caf6-4f17-979a-70965cb7dbe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.656236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e5302-caf6-4f17-979a-70965cb7dbe3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:33.657950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e5302-caf6-4f17-979a-70965cb7dbe3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:33.741511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 479/955] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:27:33.787657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec7ae-2a14-4973-94ca-d6e115fcbf32 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.787942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec7ae-2a14-4973-94ca-d6e115fcbf32 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.788207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec7ae-2a14-4973-94ca-d6e115fcbf32 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.789751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 477/956] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:33.795918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52443-7738-4222-851c-17e1c7ff373f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:33.796211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52443-7738-4222-851c-17e1c7ff373f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:33.796474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52443-7738-4222-851c-17e1c7ff373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:33.820506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-26c52443-7738-4222-851c-17e1c7ff373f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:33.822101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-26c52443-7738-4222-851c-17e1c7ff373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:33.841232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:33.908113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 480/957] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:34.176319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec7ae-2a14-4973-94ca-d6e115fcbf32 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:34.274714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:34.289954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec7ae-2a14-4973-94ca-d6e115fcbf32 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:34.325464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:34.326358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:34.326786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:34.327248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:34.327998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:34.330095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:34.339432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:34.340793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:34.341860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:34.344358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 478/958] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:34.355217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52443-7738-4222-851c-17e1c7ff373f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:34.455027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52443-7738-4222-851c-17e1c7ff373f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:34.489722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e613162-2039-4bac-847f-2d4bda3b1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:34.490313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e613162-2039-4bac-847f-2d4bda3b1e75 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:34.490588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e613162-2039-4bac-847f-2d4bda3b1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:34.490856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e613162-2039-4bac-847f-2d4bda3b1e75 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:34.491501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e613162-2039-4bac-847f-2d4bda3b1e75 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:34.491802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e613162-2039-4bac-847f-2d4bda3b1e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:34.493272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e613162-2039-4bac-847f-2d4bda3b1e75 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:34.498406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 481/959] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:34.504789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:34.613113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa171b06-5fa7-4fe9-b12e-507ba43a0165 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:34.650645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2009f2-8899-4840-85f3-abab70169783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:34.651274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2009f2-8899-4840-85f3-abab70169783 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:34.651556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2009f2-8899-4840-85f3-abab70169783 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:34.651826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2009f2-8899-4840-85f3-abab70169783 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:34.652463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2009f2-8899-4840-85f3-abab70169783 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:34.652764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2009f2-8899-4840-85f3-abab70169783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:34.654238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2009f2-8899-4840-85f3-abab70169783 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:34.659675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 479/960] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:35.372225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3679d-faa7-448b-bb1e-64b1c30028e6 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:35.373276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3679d-faa7-448b-bb1e-64b1c30028e6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:35.373783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3679d-faa7-448b-bb1e-64b1c30028e6 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:35.375665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 482/961] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:35.381534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e063a4-89f7-4b10-b413-c89d49c68b94 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:35.382405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e063a4-89f7-4b10-b413-c89d49c68b94 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:35.382880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e063a4-89f7-4b10-b413-c89d49c68b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:35.402617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c0e063a4-89f7-4b10-b413-c89d49c68b94 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:35.404238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c0e063a4-89f7-4b10-b413-c89d49c68b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:35.418312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:35.479327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 480/962] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:35.630410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e9e2-2ca2-442a-8117-971b751a6359 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:35.630588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e9e2-2ca2-442a-8117-971b751a6359 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:35.630859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e9e2-2ca2-442a-8117-971b751a6359 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:35.632521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 483/963] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:35.637693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620132-b177-4912-acf3-daf1653ac130 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:35.638225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620132-b177-4912-acf3-daf1653ac130 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:35.638704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620132-b177-4912-acf3-daf1653ac130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:35.666569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-91620132-b177-4912-acf3-daf1653ac130 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:35.667797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-91620132-b177-4912-acf3-daf1653ac130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:35.716114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be0ab-739a-4eb7-86f5-c0aa72a2289c None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:35.716487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be0ab-739a-4eb7-86f5-c0aa72a2289c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:35.716698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be0ab-739a-4eb7-86f5-c0aa72a2289c None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:35.722431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 484/964] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:35.723896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066fb5-2b31-4335-8262-9014a7163dee None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:35.724179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066fb5-2b31-4335-8262-9014a7163dee None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:35.724456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066fb5-2b31-4335-8262-9014a7163dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:35.741382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 481/965] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:35.748248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-fb066fb5-2b31-4335-8262-9014a7163dee None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:35.748248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-fb066fb5-2b31-4335-8262-9014a7163dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:35.755577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:35.768520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620132-b177-4912-acf3-daf1653ac130 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:35.830105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 485/966] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:35.864540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:35.887135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620132-b177-4912-acf3-daf1653ac130 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:35.922208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:35.923683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:35.924174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:35.924638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:35.935239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:35.940857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:35.941819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:35.942658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:35.945316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 482/967] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 1 16:27:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:35.951409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066fb5-2b31-4335-8262-9014a7163dee None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.023949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.057500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066fb5-2b31-4335-8262-9014a7163dee None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.092838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.093259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.093537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.093806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.094559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:36.094863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.096264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.105061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 486/968] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 1 16:27:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:36.109772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.112118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:36.158434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7851b-e209-4940-bbd8-7d76a0976a5a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.191908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.192608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.192969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.193305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.194024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.195548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.198132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING keystone.server.flask.common [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:27:36.208482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:36.221995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673cf7-576a-448e-8f55-e8220084d118 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.236863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.sql.core [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:27:36.236863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:27:36.236863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [parameters: {'user_id': 'e1dc59dd90d04cdba51eed3af4fb4d03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:27:36.236863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application result.read() Sep 01 16:27:36.254143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:27:36.255126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application yield resource Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise self.value Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application session.commit() Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:27:36.256102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:27:36.257004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:27:36.257956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application result.read() Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:27:36.258798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e1dc59dd90d04cdba51eed3af4fb4d03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:36.259683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 16:27:36.260507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 483/969] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 1 16:27:36 2022] POST /identity/v3/users => generated 160 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:36.261462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.265086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.265779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.266059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.266896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.267510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.268919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:36.278832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:36.279924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:36.280763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:36.285271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 487/970] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:36.286015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.364205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:36.368161 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027839-d419-4cc2-b452-fe3b840479aa None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.399578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c29911-a3f1-42b8-9a2d-4c1280d3638d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.405517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.406146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.406417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.406705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.418745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.420734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.433959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.434582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:36.434689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:36.435647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:36.436572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:36.436572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:36.436572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:36.437307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.437307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.437453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 484/971] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:36.437453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.446928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.448524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:36.461450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:36.462608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:36.463573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 488/972] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:36.464221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.502314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:36.555015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e409-cc99-414f-89f4-0472a37f20fd None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.577962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f65caf-0f3c-49a4-8762-cb6f2322287e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.592152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.592760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.593039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.593312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.593940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:36.594242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.595869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.604322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 485/973] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:36.605127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.611685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:36.619846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.622984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.622984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.622984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.622984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:36.622984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.623672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.635945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 489/974] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:36.636770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.709903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ab5e4-0297-47c1-99f6-98c3033f4e66 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.725263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:36.741031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e481-a962-469b-bbd0-9302709f63f1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.743028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6cc8-3a28-49f4-ae9d-bd8966c1ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.743661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6cc8-3a28-49f4-ae9d-bd8966c1ebde None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.743939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6cc8-3a28-49f4-ae9d-bd8966c1ebde None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.744202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6cc8-3a28-49f4-ae9d-bd8966c1ebde None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.744887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6cc8-3a28-49f4-ae9d-bd8966c1ebde None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:36.745184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6cc8-3a28-49f4-ae9d-bd8966c1ebde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.746654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6cc8-3a28-49f4-ae9d-bd8966c1ebde None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.774817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.775439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.775713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.775976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.776583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:36.776893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.778244 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.781404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 486/975] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:36.783023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b1f27-2d29-4746-953e-cdae99315e30 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.783333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b1f27-2d29-4746-953e-cdae99315e30 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.788447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b1f27-2d29-4746-953e-cdae99315e30 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.788632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 490/976] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:36.788632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.788804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 487/977] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:36.789526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b1f27-2d29-4746-953e-cdae99315e30 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.856184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:36.913181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317ffaf-4eaf-4365-ab21-a911f4cb1bdb None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.914998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b1f27-2d29-4746-953e-cdae99315e30 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:36.952546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f0743-07a6-4dd4-af38-9b302b94610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.953155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0743-07a6-4dd4-af38-9b302b94610c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.953437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0743-07a6-4dd4-af38-9b302b94610c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.953745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0743-07a6-4dd4-af38-9b302b94610c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.954458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f0743-07a6-4dd4-af38-9b302b94610c None admin] RBAC: Adding query filter params (interface=admin, service_id=9d7527cd815044c7b1c94a8aad775161, region_id=RegionOne) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:36.954766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f0743-07a6-4dd4-af38-9b302b94610c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.955969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:36.956170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f0743-07a6-4dd4-af38-9b302b94610c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.956604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.956882 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.957154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.962444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 488/978] 10.222.0.69 () {56 vars in 1249 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/endpoints?service_id=9d7527cd815044c7b1c94a8aad775161&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:36.963981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2a61-843d-4329-943f-16d5512608a9 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:36.964267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2a61-843d-4329-943f-16d5512608a9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:36.964540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2a61-843d-4329-943f-16d5512608a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:36.965914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:36.967393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:36.984801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:36.986355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 491/979] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:36.987553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:36.990265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ab7d2a61-843d-4329-943f-16d5512608a9 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:36.991392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ab7d2a61-843d-4329-943f-16d5512608a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:37.027824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:37.069954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 489/980] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:37.070801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d2a61-843d-4329-943f-16d5512608a9 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:37.105137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f57d10-a030-4df3-9718-a8ff9ded3eaf None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:37.118816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:37.140635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:37.141265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:37.141545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:37.141829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:37.142426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:37.143825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:37.159714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 492/981] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:36 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:27:37.184114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d2a61-843d-4329-943f-16d5512608a9 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:37.223266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:37.223811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:37.224092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:37.224369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:37.225120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:37.225428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:37.226894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:37.247314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 490/982] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 1 16:27:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:37.253586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:37.337307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:37.365068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9f83e-d5bd-4e31-ae65-646d0ba2b352 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:37.367903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:37.404553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:37.405550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:37.405970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:37.406373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:37.449442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a90c5-cfaa-4c9e-b6cb-d06fd3d00b5a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:37.455442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:37.479092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:37.480534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:37.488407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:37.489027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:37.489301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:37.489573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:37.490237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:37.491639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:37.568745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 491/983] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:37 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:27:37.583363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 493/984] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:37.588998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:37.693116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:37.717147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ac093-ff6f-46f2-989a-c66b791becde None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:37.754328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:37.754887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:37.755177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:37.755468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:37.767129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:37.768704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:37.784589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:37.785547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:37.786508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:37.786508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:37.786508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:37.786508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 492/985] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:37.795572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:37.877090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:37.900005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43970b1-460d-4cc1-84a6-03d405f862e9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:37.934601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:37.935238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:37.935486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:37.935751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:37.936384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:37.936681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:37.938571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:37.949841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 494/986] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:37.955983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:38.056933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f9785-ef22-46b4-9867-aa92fbb67ab6 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:38.090450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:38.091275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:38.091645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:38.092012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:38.094005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:38.100143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:38.106592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:38.112825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:38.113874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:38.114982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:38.120134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 493/987] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:38.121788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:38.224802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d6d28-d231-48a9-aab3-595ce58792b5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:38.261576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df321da-8ee6-4f4b-83b4-3ccd83c5fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:38.262178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df321da-8ee6-4f4b-83b4-3ccd83c5fba5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:38.262456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df321da-8ee6-4f4b-83b4-3ccd83c5fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:38.262728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df321da-8ee6-4f4b-83b4-3ccd83c5fba5 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:38.263442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df321da-8ee6-4f4b-83b4-3ccd83c5fba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:38.263751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df321da-8ee6-4f4b-83b4-3ccd83c5fba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:38.265180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df321da-8ee6-4f4b-83b4-3ccd83c5fba5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:38.267746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:38.278482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 495/988] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:38.284566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:38.383483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0f8fb-16e4-4ba9-bfee-389caa81b822 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:38.416255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c9772-8141-4f72-956f-653ed3fb9769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:38.416847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c9772-8141-4f72-956f-653ed3fb9769 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:38.417125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c9772-8141-4f72-956f-653ed3fb9769 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:38.417397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c9772-8141-4f72-956f-653ed3fb9769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:38.418113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c9772-8141-4f72-956f-653ed3fb9769 None admin] RBAC: Adding query filter params (role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=260ad63e7ce34605a3af952b328fae64) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:38.418421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c9772-8141-4f72-956f-653ed3fb9769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:38.419864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c9772-8141-4f72-956f-653ed3fb9769 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:38.426175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 494/989] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:38 2022] GET /identity/v3/role_assignments?user.id=260ad63e7ce34605a3af952b328fae64&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:39.066754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34828-6a77-494d-9fa6-35547394cd03 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:39.067318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34828-6a77-494d-9fa6-35547394cd03 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:39.067318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34828-6a77-494d-9fa6-35547394cd03 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:39.068711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 496/990] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:39.073731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede42ac-d74f-46a7-969e-776a41b91dbf None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:39.074110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede42ac-d74f-46a7-969e-776a41b91dbf None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:39.074281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede42ac-d74f-46a7-969e-776a41b91dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:39.092536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1ede42ac-d74f-46a7-969e-776a41b91dbf None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:39.093724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1ede42ac-d74f-46a7-969e-776a41b91dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:39.148219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:39.161890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 495/991] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:39.435137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d34828-6a77-494d-9fa6-35547394cd03 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:39.507366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2082e9-1c39-4424-8ebe-87febafaa09b None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:39.507716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2082e9-1c39-4424-8ebe-87febafaa09b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:39.507927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2082e9-1c39-4424-8ebe-87febafaa09b None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:39.509431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 496/992] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:39.514345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542d86-74c7-4f97-b5d3-7a5f5e364e0e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:39.515422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542d86-74c7-4f97-b5d3-7a5f5e364e0e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:39.515721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542d86-74c7-4f97-b5d3-7a5f5e364e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:39.537348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8a542d86-74c7-4f97-b5d3-7a5f5e364e0e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:39.538561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8a542d86-74c7-4f97-b5d3-7a5f5e364e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:39.546851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d34828-6a77-494d-9fa6-35547394cd03 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:39.585401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:39.586029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:39.586305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:39.586583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:39.587185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:39.588575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:39.598000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:39.599012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:39.599931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 497/993] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 1 16:27:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:39.604815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:39.615245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 497/994] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:39.670625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:39.711445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37480-1c56-4cb2-bb00-60961c348e23 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:39.744804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:39.745405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:39.745741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:39.746017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:39.746637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:39.746945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:39.748355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:39.757751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 498/995] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:39.758811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542d86-74c7-4f97-b5d3-7a5f5e364e0e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:39.859173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542d86-74c7-4f97-b5d3-7a5f5e364e0e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:39.876252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:39.881707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:39.893805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:39.894408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:39.894684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:39.894948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:39.895608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:39.902415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:39.902415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:39.902993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 498/996] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 1 16:27:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:39.908842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:39.990261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778d00-46c4-4a09-8df8-31b628145b32 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:40.010752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd943d5-765e-485d-b270-154fcfc0db05 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:40.013556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:40.025182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:40.028225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.028225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.028225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.028225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:40.028573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:40.040579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:40.041700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:40.042560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 499/997] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:40.046224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:40.046841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.047104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.047506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.048175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:40.049538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:40.049651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:40.134371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 499/998] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:27:40.153926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87feef2-14bc-474b-9bb6-fc02bfee4120 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:40.199053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:40.199712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.199989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.200256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.200889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:40.201188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:40.202568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:40.213429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 500/999] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:40.215132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:40.263391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:40.327070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c543c-03c0-44a7-aa3c-a22f8a4ee632 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:40.363057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee98e3-e99c-4eea-b0bc-2ef628175437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:40.363925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee98e3-e99c-4eea-b0bc-2ef628175437 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.364347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee98e3-e99c-4eea-b0bc-2ef628175437 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.364788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee98e3-e99c-4eea-b0bc-2ef628175437 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.365584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee98e3-e99c-4eea-b0bc-2ef628175437 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:40.366023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee98e3-e99c-4eea-b0bc-2ef628175437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:40.367541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee98e3-e99c-4eea-b0bc-2ef628175437 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:40.372849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 500/1000] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:40.379608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:40.385310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22fde2-d73d-4615-86c4-aaf90747e401 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.385643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22fde2-d73d-4615-86c4-aaf90747e401 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.385918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22fde2-d73d-4615-86c4-aaf90747e401 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.387430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 501/1001] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:40.392761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2977-ab51-4531-ac31-e9a71b94dfc5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.393050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2977-ab51-4531-ac31-e9a71b94dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.393304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2977-ab51-4531-ac31-e9a71b94dfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.411796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-555d2977-ab51-4531-ac31-e9a71b94dfc5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:40.412736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-555d2977-ab51-4531-ac31-e9a71b94dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:40.433051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:40.481965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 502/1002] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:40.487569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a21e-64c4-4da1-9ddf-ec5e00e23e91 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:40.522907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:40.523837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.524338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.524833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.525726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] RBAC: Adding query filter params (interface=public, service_id=c84af3e9e9644874a54a5183cf128748, region_id=RegionOne) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:40.526237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:40.527840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:40.534108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 501/1003] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:27:40 2022] GET /identity/v3/endpoints?service_id=c84af3e9e9644874a54a5183cf128748&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:40.539364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d2977-ab51-4531-ac31-e9a71b94dfc5 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:40.574918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:40.644574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d2977-ab51-4531-ac31-e9a71b94dfc5 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:40.689395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:40.690008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.690286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.690556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.691190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:40.692556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:40.704031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 503/1004] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:40 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:27:40.756720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:40.865191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a2136-72f6-4463-8578-a04868f620fd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:40.878772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:40.899629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:40.900256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:40.903216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:40.903216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] PATH_INFO: `/v3/services/image` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:40.903216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:40.903216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:40.911874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:40.912964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:40.913847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 502/1005] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Sep 1 16:27:40 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:40.919454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:41.021788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:41.025621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124450c-4478-48b9-bf3d-3c8f83616fbd None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:41.060479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a08fd-9ebb-4f89-a2f9-5438df40c2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:41.061236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a08fd-9ebb-4f89-a2f9-5438df40c2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:41.061501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a08fd-9ebb-4f89-a2f9-5438df40c2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:41.061829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a08fd-9ebb-4f89-a2f9-5438df40c2c5 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:41.062518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a08fd-9ebb-4f89-a2f9-5438df40c2c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:41.062913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a08fd-9ebb-4f89-a2f9-5438df40c2c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:41.064365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a08fd-9ebb-4f89-a2f9-5438df40c2c5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:41.073892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 504/1006] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:41.074884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:41.178572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9192e6-a0c7-4abf-b4e0-46590f29b03d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:41.219991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22280e28-8277-493e-8f39-e84fd51304ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:41.220597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22280e28-8277-493e-8f39-e84fd51304ab None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:41.220871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22280e28-8277-493e-8f39-e84fd51304ab None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:41.221144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22280e28-8277-493e-8f39-e84fd51304ab None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:41.221773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22280e28-8277-493e-8f39-e84fd51304ab None admin] RBAC: Adding query filter params (type=image) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:41.222075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22280e28-8277-493e-8f39-e84fd51304ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:41.223464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22280e28-8277-493e-8f39-e84fd51304ab None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:41.227920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 503/1007] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:42.091709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6963f4-61ca-4189-ac92-be12a6637d55 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:42.092261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6963f4-61ca-4189-ac92-be12a6637d55 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:42.092261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6963f4-61ca-4189-ac92-be12a6637d55 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:42.093734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 505/1008] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:42.098658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4edb2-4280-45eb-ae86-1ed2d0a043db None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:42.098946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4edb2-4280-45eb-ae86-1ed2d0a043db None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:42.099256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4edb2-4280-45eb-ae86-1ed2d0a043db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:42.118017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5ec4edb2-4280-45eb-ae86-1ed2d0a043db None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:42.119229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5ec4edb2-4280-45eb-ae86-1ed2d0a043db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:42.153908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:42.192169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 504/1009] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:42.462616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6963f4-61ca-4189-ac92-be12a6637d55 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:42.561597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6963f4-61ca-4189-ac92-be12a6637d55 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:42.594993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e52a0-4e6b-426f-bb1f-ed325b40b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:42.595665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e52a0-4e6b-426f-bb1f-ed325b40b642 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:42.595940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e52a0-4e6b-426f-bb1f-ed325b40b642 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:42.596208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e52a0-4e6b-426f-bb1f-ed325b40b642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:42.597317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e52a0-4e6b-426f-bb1f-ed325b40b642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:42.598729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e52a0-4e6b-426f-bb1f-ed325b40b642 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:42.600481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 506/1010] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:42.606149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4edb2-4280-45eb-ae86-1ed2d0a043db None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:42.615261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d9f3-296b-46ad-bf8c-1352176d63eb None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:42.615545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d9f3-296b-46ad-bf8c-1352176d63eb None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:42.615816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d9f3-296b-46ad-bf8c-1352176d63eb None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:42.617142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 507/1011] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:42.621945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79c86-8725-4ca2-9b40-513be7186370 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:42.622224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79c86-8725-4ca2-9b40-513be7186370 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:42.622495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79c86-8725-4ca2-9b40-513be7186370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:42.641612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-27c79c86-8725-4ca2-9b40-513be7186370 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:42.642813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-27c79c86-8725-4ca2-9b40-513be7186370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:42.675613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:42.727269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 508/1012] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:42.731173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4edb2-4280-45eb-ae86-1ed2d0a043db None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:42.762447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35cab0-c08e-4a0e-9dd7-0df9937c225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:42.763048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cab0-c08e-4a0e-9dd7-0df9937c225a None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:42.763411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cab0-c08e-4a0e-9dd7-0df9937c225a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:42.763620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cab0-c08e-4a0e-9dd7-0df9937c225a None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:42.764278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35cab0-c08e-4a0e-9dd7-0df9937c225a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:42.765699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35cab0-c08e-4a0e-9dd7-0df9937c225a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:42.879048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 505/1013] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:42 2022] POST /identity/v3/projects => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:42.994433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79c86-8725-4ca2-9b40-513be7186370 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:43.101291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79c86-8725-4ca2-9b40-513be7186370 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:43.136662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:43.137297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.137576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.137850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.138431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:43.139889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:43.143976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6954d-2411-4fd9-8315-21d623fd978f None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.144381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6954d-2411-4fd9-8315-21d623fd978f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.144722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6954d-2411-4fd9-8315-21d623fd978f None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.146547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 506/1014] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:43.149401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:43.150398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:43.151278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 509/1015] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:43.153880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9847-20ac-4b8c-93dc-55ce5a330cf4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.154166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9847-20ac-4b8c-93dc-55ce5a330cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.154440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9847-20ac-4b8c-93dc-55ce5a330cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.156105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:43.176959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-24eb9847-20ac-4b8c-93dc-55ce5a330cf4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:43.178474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-24eb9847-20ac-4b8c-93dc-55ce5a330cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:43.187658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:43.195676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:43.247626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 507/1016] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:43.264017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16780a62-bc80-4e04-8f53-b9d75e3bbffa None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:43.299824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:43.300419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.300693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.300959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.301581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:43.301876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:43.303252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:43.358957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 510/1017] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:43.364811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb9847-20ac-4b8c-93dc-55ce5a330cf4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:43.467324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb9847-20ac-4b8c-93dc-55ce5a330cf4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:43.501954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:43.502601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.502885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.503175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.503802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:43.504103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:43.505468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:43.514972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 508/1018] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 1 16:27:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:43.516471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:43.526324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:43.544860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:43.612802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:43.624362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4102-c8b8-454f-b97e-91533b8ced2a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:43.627401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e500-7b71-4625-a94d-f9a382c6673b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:43.665127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5ebd3-89b6-4e54-97e3-e26373d85ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:43.665735 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ebd3-89b6-4e54-97e3-e26373d85ad0 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.666014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ebd3-89b6-4e54-97e3-e26373d85ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.666290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ebd3-89b6-4e54-97e3-e26373d85ad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.666968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5ebd3-89b6-4e54-97e3-e26373d85ad0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:43.667750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637479df-661d-4d49-b621-2d7d2b03855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:43.668372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5ebd3-89b6-4e54-97e3-e26373d85ad0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:43.668687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637479df-661d-4d49-b621-2d7d2b03855a None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.669104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637479df-661d-4d49-b621-2d7d2b03855a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.669533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637479df-661d-4d49-b621-2d7d2b03855a None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.670323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637479df-661d-4d49-b621-2d7d2b03855a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:43.671852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637479df-661d-4d49-b621-2d7d2b03855a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:43.757793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 509/1019] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:27:43 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:27:43.826439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 511/1020] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:27:44.826064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4b8d-c7c4-4e1b-ab9d-1a403396a3a3 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:44.826616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4b8d-c7c4-4e1b-ab9d-1a403396a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:44.826616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4b8d-c7c4-4e1b-ab9d-1a403396a3a3 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:44.828141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 510/1021] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:44.833489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7b85-e10d-4d2f-9298-51213aeda678 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:44.833913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7b85-e10d-4d2f-9298-51213aeda678 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:44.834017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7b85-e10d-4d2f-9298-51213aeda678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:44.854669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9c6d7b85-e10d-4d2f-9298-51213aeda678 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:44.855882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9c6d7b85-e10d-4d2f-9298-51213aeda678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:44.930207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 512/1022] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:45.202492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c4b8d-c7c4-4e1b-ab9d-1a403396a3a3 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:45.283225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:45.307281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c4b8d-c7c4-4e1b-ab9d-1a403396a3a3 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:45.341552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eeb66-605e-4b3c-a1e8-dbfdb6731665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:45.342179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eeb66-605e-4b3c-a1e8-dbfdb6731665 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:45.342457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eeb66-605e-4b3c-a1e8-dbfdb6731665 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:45.342726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eeb66-605e-4b3c-a1e8-dbfdb6731665 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:45.344386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eeb66-605e-4b3c-a1e8-dbfdb6731665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:45.345890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eeb66-605e-4b3c-a1e8-dbfdb6731665 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:45.347712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 511/1023] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:45.353338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d7b85-e10d-4d2f-9298-51213aeda678 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:45.426376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:45.455458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d7b85-e10d-4d2f-9298-51213aeda678 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:45.490086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f8f83-2e0e-4a04-8dab-3bdfc30cbad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:45.490692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8f83-2e0e-4a04-8dab-3bdfc30cbad6 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:45.490968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8f83-2e0e-4a04-8dab-3bdfc30cbad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:45.491276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f8f83-2e0e-4a04-8dab-3bdfc30cbad6 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:45.491935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f8f83-2e0e-4a04-8dab-3bdfc30cbad6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:45.493361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f8f83-2e0e-4a04-8dab-3bdfc30cbad6 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:45.602166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 513/1024] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:27:45 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:45.688541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c413-0d17-45c4-96e4-921d34f50634 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:45.688893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c413-0d17-45c4-96e4-921d34f50634 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:45.689099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c413-0d17-45c4-96e4-921d34f50634 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:45.690497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 512/1025] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:45.696258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f2d-aca0-4ada-879a-20350c2d5c66 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:45.696546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f2d-aca0-4ada-879a-20350c2d5c66 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:45.696830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f2d-aca0-4ada-879a-20350c2d5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:45.716511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b9fe8f2d-aca0-4ada-879a-20350c2d5c66 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:45.717661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b9fe8f2d-aca0-4ada-879a-20350c2d5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:45.788150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 514/1026] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:45.850164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6994e-0dfd-420d-a727-70f5fae1de93 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:45.850706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6994e-0dfd-420d-a727-70f5fae1de93 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:45.850706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6994e-0dfd-420d-a727-70f5fae1de93 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:45.852076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 513/1027] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:45.857186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed3ae-b6ca-4892-92a4-a778fb4310f5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:45.857593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed3ae-b6ca-4892-92a4-a778fb4310f5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:45.857777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed3ae-b6ca-4892-92a4-a778fb4310f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:45.875675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6fbed3ae-b6ca-4892-92a4-a778fb4310f5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:45.876853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6fbed3ae-b6ca-4892-92a4-a778fb4310f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:45.932705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:45.947141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 515/1028] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:46.058784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6994e-0dfd-420d-a727-70f5fae1de93 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.159511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6994e-0dfd-420d-a727-70f5fae1de93 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.193358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.193981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.194254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.194521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] PATH_INFO: `/v3/services/image` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.195098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.196485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:46.205199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:46.206398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:46.207493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 514/1029] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:46.212356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed3ae-b6ca-4892-92a4-a778fb4310f5 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.213913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.228691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:46.321506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed3ae-b6ca-4892-92a4-a778fb4310f5 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.324426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e7c19-6154-44da-9fc9-96e3396c85ac None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.357661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.358316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.358592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.358882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.360288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.360953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.361227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.361495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.362088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] RBAC: Adding query filter params (name=image) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:46.362406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.363816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.371444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 516/1030] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:46.374667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.374781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:46.380913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:46.381824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:46.387816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 515/1031] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:46.388521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.431791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:46.456817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:46.481065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080d21-1de0-4bf6-9339-69c586fe2437 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.489686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d8296-a7a9-40c3-ac68-ab0bd34114fc None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.518030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.518638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.518915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.519230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.519863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:46.520164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.521790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.525709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.526533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.526643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 517/1032] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:46.527326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.527839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.528694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:46.529190 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.530730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.532915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.540292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 516/1033] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:46.545727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.644459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5eb13-3417-4912-b2aa-d9080b430fc7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.649166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48a3a-c4e9-4340-b533-45cfc2ad74b1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.664022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:46.682421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.682640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:46.683024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.683312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.683582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.684271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] RBAC: Adding query filter params (interface=public, service_id=a5f0545cfc074df18404563536c54d27, region_id=RegionOne) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:46.684572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.685917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.690445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.691309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.691444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 518/1034] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/endpoints?service_id=a5f0545cfc074df18404563536c54d27&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:46.691924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.692389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.696889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.703585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.705332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:46.720024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:46.721226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:46.722374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:46.722374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:46.722374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:46.723274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 517/1035] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:46.729855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.807218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0e8b-29b4-4bfe-8e40-e6b2ae61c770 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.844301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37729549-471c-448b-8af7-06008119ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.845126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37729549-471c-448b-8af7-06008119ae56 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.845402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37729549-471c-448b-8af7-06008119ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.845722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37729549-471c-448b-8af7-06008119ae56 None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.846327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37729549-471c-448b-8af7-06008119ae56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.846730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a444c-ba33-4ef2-9b4c-138b18bfaaa3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:46.847712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37729549-471c-448b-8af7-06008119ae56 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.854441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 519/1036] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:27:46.883612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:46.884317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:46.884524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:46.884774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:46.885439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:46.885745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:46.887180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:46.905954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 518/1037] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:46.907856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37729549-471c-448b-8af7-06008119ae56 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:46.961216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:47.018809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37729549-471c-448b-8af7-06008119ae56 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:47.056893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:47.057516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:47.057792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:47.058058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:47.065248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:47.066663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:47.078552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:47.079564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:47.080542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 520/1038] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:27:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:47.085502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:47.130926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:47.188177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2afcb0-3bc9-4b48-bf19-b424e3f7b69c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:47.222509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:47.223101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:47.223439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:47.223693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:47.224406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:47.224787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:47.226152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:47.244140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 519/1039] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:27:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:47.249705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:47.355941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d7874-0eb7-4a54-a1c9-53d83570bfc7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:47.358278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:47.392823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730953f-e083-4922-8462-e79a85bd6b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:47.393422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730953f-e083-4922-8462-e79a85bd6b47 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:47.393695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730953f-e083-4922-8462-e79a85bd6b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:47.393959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730953f-e083-4922-8462-e79a85bd6b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:47.461410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730953f-e083-4922-8462-e79a85bd6b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:47.462762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730953f-e083-4922-8462-e79a85bd6b47 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:47.565013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 521/1040] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:27:47.566626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:47.587248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa487-68d5-4b68-a58b-1c01e0456ac2 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:47.587548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa487-68d5-4b68-a58b-1c01e0456ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:47.587865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa487-68d5-4b68-a58b-1c01e0456ac2 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:47.589433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 522/1041] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:47.594712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b84d1-9987-48d0-a19c-95a686feb9c2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:47.594998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b84d1-9987-48d0-a19c-95a686feb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:47.595332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b84d1-9987-48d0-a19c-95a686feb9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:47.602423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:47.616364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-da5b84d1-9987-48d0-a19c-95a686feb9c2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:47.617562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-da5b84d1-9987-48d0-a19c-95a686feb9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:47.679528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:47.683488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd781c-9859-408c-9ac2-bebddac02774 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:47.686541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 523/1042] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:47.719133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:47.719722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:47.720049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:47.720319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:47.730836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:47.732378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:47.747603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:47.748573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:47.749523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:47.749523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:47.749523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:47.750781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 520/1043] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:47.755178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b84d1-9987-48d0-a19c-95a686feb9c2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:47.855290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b84d1-9987-48d0-a19c-95a686feb9c2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:47.888899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:47.889496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:47.889769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:47.890035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:47.891350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:47.891664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:47.893021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:47.894542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:47.909826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 524/1044] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:47.912055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:47.952889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:48.023751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e81b9-da0a-4d00-9e32-9d4480989040 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.058457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.059078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.059388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.059663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.066785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:48.067877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc52da-b53c-492b-b9ff-36330cc0e758 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.068342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:48.081121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:48.082079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:48.083848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 521/1045] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:48.087947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:48.103903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:48.105613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.106240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.106542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.106827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.118218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:48.123031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:48.123975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:48.125434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 525/1046] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:48.130034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:48.185551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:48.193706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e642c1-8836-4b4c-89c2-68612ef7b1a6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.229510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.230165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.230448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.230722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.231446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe62af-83c3-426d-8e69-3d003a59c797 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.231574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:48.231755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:48.233185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:48.245600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 522/1047] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:48.252237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:48.277778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.278305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.278639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.278915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.279624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:48.279925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:48.281800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:48.290511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 526/1048] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:48.295801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:48.334641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:48.367282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd12901-a497-471b-9e84-0902ec794bd3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.401096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21b876-3b89-4b26-8776-e8d483e027fa None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.401613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.402218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.402497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.402774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.403534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] RBAC: Adding query filter params (role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=1276878b8f0541398e54be24543abd85) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:48.403844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:48.405312 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:48.411316 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 523/1049] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:48 2022] GET /identity/v3/role_assignments?user.id=1276878b8f0541398e54be24543abd85&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:48.429260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:48.448898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb028720-221c-4c71-b593-fa75e7484751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.449549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028720-221c-4c71-b593-fa75e7484751 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.449828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028720-221c-4c71-b593-fa75e7484751 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.450100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028720-221c-4c71-b593-fa75e7484751 None admin] PATH_INFO: `/v3/users/d3ebbb3c1e2e40939f4d30b8d2e79d22` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.465543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb028720-221c-4c71-b593-fa75e7484751 None admin] RBAC: Authorizing `identity:get_user(user_id=d3ebbb3c1e2e40939f4d30b8d2e79d22)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:48.467050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb028720-221c-4c71-b593-fa75e7484751 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:48.469569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 527/1050] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:27:48 2022] GET /identity/v3/users/d3ebbb3c1e2e40939f4d30b8d2e79d22 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:48.475528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:48.585902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3ec17-dbb2-47f1-8a4d-626ede9d395b None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.620034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.620637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.620915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.621186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.624622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:48.702843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:48.704896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:48.799506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bb75-01af-43c9-b1ad-519dba6bf2c4 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.799898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bb75-01af-43c9-b1ad-519dba6bf2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.800072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bb75-01af-43c9-b1ad-519dba6bf2c4 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.803200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 528/1051] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:48.806482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93d02-5164-44c7-bc3d-9ef8d3cbf597 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.806771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93d02-5164-44c7-bc3d-9ef8d3cbf597 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.807044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93d02-5164-44c7-bc3d-9ef8d3cbf597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.808094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 524/1052] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:27:48.813656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:48.831056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-eab93d02-5164-44c7-bc3d-9ef8d3cbf597 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:48.832270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-eab93d02-5164-44c7-bc3d-9ef8d3cbf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:48.851727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:48.904091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 529/1053] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:48.918406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5a64-939a-4475-a02d-e6b970611ba6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:48.952898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:48.953543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.953817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.954087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.955225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] RBAC: Authorizing `identity:get_project(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:48.956654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:48.963314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 525/1054] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:27:48 2022] GET /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:48.964315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93d02-5164-44c7-bc3d-9ef8d3cbf597 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:49.066144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93d02-5164-44c7-bc3d-9ef8d3cbf597 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:49.068468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:49.100934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:49.101536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.101862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.102079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.102793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56, user.id=d3ebbb3c1e2e40939f4d30b8d2e79d22) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:49.103096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:49.104533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:49.119434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 530/1055] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:48 2022] GET /identity/v3/role_assignments?user.id=d3ebbb3c1e2e40939f4d30b8d2e79d22&scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:49.180132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:49.289252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9c0fb-0a02-4e66-9911-d11d9ebdcc8a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:49.291603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:49.324144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:49.324768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.325043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.325312 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] PATH_INFO: `/v3/services/image` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.325891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:49.327275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:49.336070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:49.337079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:27:49.337914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:49.339248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 526/1056] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Sep 1 16:27:49 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:49.343111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:49.445985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0169c-3541-4858-acba-555a2f05a384 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:49.480952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:49.481569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.481844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.482118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.482755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] RBAC: Adding query filter params (name=image) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:49.483055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:49.484979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:49.494641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 531/1057] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:49.496023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:49.598350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46374209-74c0-4071-b45f-e35f31266f38 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:49.631009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece9202-6302-4f6a-8538-1dc0e931ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:49.631625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9202-6302-4f6a-8538-1dc0e931ba9b None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.631898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9202-6302-4f6a-8538-1dc0e931ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.632161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9202-6302-4f6a-8538-1dc0e931ba9b None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.632778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece9202-6302-4f6a-8538-1dc0e931ba9b None admin] RBAC: Adding query filter params (type=image) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:49.633072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece9202-6302-4f6a-8538-1dc0e931ba9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:49.634414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece9202-6302-4f6a-8538-1dc0e931ba9b None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:49.643233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 527/1058] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:49.645675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:49.680578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:49.752764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff469-eec1-4212-9d1f-d33c640958ee None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:49.786753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6172d-abd1-4885-9673-c5582599155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:49.787375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6172d-abd1-4885-9673-c5582599155c None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.787648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6172d-abd1-4885-9673-c5582599155c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.787912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6172d-abd1-4885-9673-c5582599155c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.788578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6172d-abd1-4885-9673-c5582599155c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:49.789921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6172d-abd1-4885-9673-c5582599155c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:49.892852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 532/1059] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:27:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:27:50.323239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cac2f3-4528-479c-9cc3-e5c5f2212f2b None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:50.323760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cac2f3-4528-479c-9cc3-e5c5f2212f2b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:50.323838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cac2f3-4528-479c-9cc3-e5c5f2212f2b None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:50.325172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 528/1060] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:50.330353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c48ec-8fd6-4763-9a54-02901ee2145d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:50.330731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c48ec-8fd6-4763-9a54-02901ee2145d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:50.330899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c48ec-8fd6-4763-9a54-02901ee2145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:50.348823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c88c48ec-8fd6-4763-9a54-02901ee2145d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:50.350018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c88c48ec-8fd6-4763-9a54-02901ee2145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:50.428986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 533/1061] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:50.702435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cac2f3-4528-479c-9cc3-e5c5f2212f2b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:50.733999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:50.805397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cac2f3-4528-479c-9cc3-e5c5f2212f2b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:50.837940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30965485-3d56-4567-b249-4e45f7a88b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:50.838551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30965485-3d56-4567-b249-4e45f7a88b20 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:50.838822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30965485-3d56-4567-b249-4e45f7a88b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:50.839085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30965485-3d56-4567-b249-4e45f7a88b20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:50.849441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30965485-3d56-4567-b249-4e45f7a88b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-30965485-3d56-4567-b249-4e45f7a88b20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:50.854181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:50.855093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:50.855992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:50.859922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 529/1062] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 1 16:27:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:50.862044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c48ec-8fd6-4763-9a54-02901ee2145d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:50.877762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:50.964468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c48ec-8fd6-4763-9a54-02901ee2145d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.003168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.003799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.004075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.004345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.005038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:51.005339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.006721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.014670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1352-db13-40e6-af9e-cec744f0a356 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.014958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1352-db13-40e6-af9e-cec744f0a356 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.015263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1352-db13-40e6-af9e-cec744f0a356 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.020420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 534/1063] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 1 16:27:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:51.020540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 530/1064] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:51.021634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.023021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d6939-7eec-48c6-a795-09892675bb3a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.023353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d6939-7eec-48c6-a795-09892675bb3a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.023629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d6939-7eec-48c6-a795-09892675bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.042080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-239d6939-7eec-48c6-a795-09892675bb3a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:51.043448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-239d6939-7eec-48c6-a795-09892675bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:51.112070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:51.117257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 531/1065] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:51.134673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a530f-c256-4744-b2ea-caca895b62d8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.169506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.170130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.170406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.170674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.181443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.182867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:51.197043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:51.197999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:51.204214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:51.204214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:51.204214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:51.204214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 535/1066] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:51.204602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d6939-7eec-48c6-a795-09892675bb3a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.229724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:51.304286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d6939-7eec-48c6-a795-09892675bb3a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.338602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.339440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.339536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.339758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.340397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:51.340698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.342059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.358115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 532/1067] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:51.359505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.402983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.468733 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc500-233c-4405-b02b-4f402ac3bff8 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.496973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:51.497853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:51.505479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.509738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.509738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.509738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.514611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.516403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3b707-eb2f-46fe-82cb-349fefd2c0a0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.516625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:51.528322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:51.529421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:51.530381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:51.531672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 536/1068] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:51.535583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.554208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.555248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.555519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.555942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.567139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:51.572004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:51.572974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:51.573861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 533/1069] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:51.579722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.660779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a7df-dec7-415d-a8ad-ac94e19a0ad4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.692066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439a5e-c18a-4efc-a43a-c526867a6bef None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.704850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.706120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.706946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.707430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.708513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:51.709387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.711749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.732378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.732696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 537/1070] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:51.733435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.733717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.733988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.735260 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:51.735569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.736940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.738774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.746918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 534/1071] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:51.753046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.756715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:51.794287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:51.850380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8fa3d-e2ec-405e-9970-41938f64797b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.854451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9a208-d832-4a9b-85e4-78ea1643fe48 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:51.884660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297ff86-bbb7-4ba2-b3d7-ab2f4579b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.885297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297ff86-bbb7-4ba2-b3d7-ab2f4579b9aa None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.885574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297ff86-bbb7-4ba2-b3d7-ab2f4579b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.885865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297ff86-bbb7-4ba2-b3d7-ab2f4579b9aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.888412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22cdd2-cfbd-456a-a75a-0b7235e290ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:51.889053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22cdd2-cfbd-456a-a75a-0b7235e290ee None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.889328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22cdd2-cfbd-456a-a75a-0b7235e290ee None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.889596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22cdd2-cfbd-456a-a75a-0b7235e290ee None admin] PATH_INFO: `/v3/users/d3ebbb3c1e2e40939f4d30b8d2e79d22` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.891281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22cdd2-cfbd-456a-a75a-0b7235e290ee None admin] RBAC: Authorizing `identity:get_user(user_id=d3ebbb3c1e2e40939f4d30b8d2e79d22)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.892712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22cdd2-cfbd-456a-a75a-0b7235e290ee None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.894292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 535/1072] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/users/d3ebbb3c1e2e40939f4d30b8d2e79d22 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:51.895419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba996-f220-48ad-91f3-43c5d3a772c2 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.895963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba996-f220-48ad-91f3-43c5d3a772c2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.896212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba996-f220-48ad-91f3-43c5d3a772c2 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.896863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297ff86-bbb7-4ba2-b3d7-ab2f4579b9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:51.897509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 536/1073] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:51.898313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297ff86-bbb7-4ba2-b3d7-ab2f4579b9aa None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:51.902121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba996-f220-48ad-91f3-43c5d3a772c2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-b297ff86-bbb7-4ba2-b3d7-ab2f4579b9aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:51.913876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:51.914890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:51.916318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:51.916318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:51.916318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:51.916318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 538/1074] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:51.916318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc272-9c2b-4c96-9674-96ed68609108 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:51.916690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc272-9c2b-4c96-9674-96ed68609108 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:51.916771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc272-9c2b-4c96-9674-96ed68609108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:51.935581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-052cc272-9c2b-4c96-9674-96ed68609108 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:51.936764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-052cc272-9c2b-4c96-9674-96ed68609108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:51.975794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.002662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 539/1075] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:52.003584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cc272-9c2b-4c96-9674-96ed68609108 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.007264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba996-f220-48ad-91f3-43c5d3a772c2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.041431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.053958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.054826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.055419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.055419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.070236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.070236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.070236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 537/1076] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:27:51 2022] GET /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:52.070236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.117690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cc272-9c2b-4c96-9674-96ed68609108 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.155388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.156010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.156286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.156551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.157531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:52.157531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.158902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.170336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 540/1077] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:52.170463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95fc2-631a-4080-8ac0-0810ff0f93f8 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.175790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.210638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.215545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.215545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.215545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56/users/d3ebbb3c1e2e40939f4d30b8d2e79d22/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.215545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56, user_id=d3ebbb3c1e2e40939f4d30b8d2e79d22, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.215545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.265121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.276998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acc060-45a8-42cb-a010-885010b85640 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.309925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.310567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.310839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.311104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.317471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.318402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.318886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.322977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 538/1078] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:27:52 2022] PUT /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56/users/d3ebbb3c1e2e40939f4d30b8d2e79d22/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:27:52.330410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:52.330555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:52.331627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:52.332548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:52.336410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 541/1079] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:52.337237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.443276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e571ec-1a4d-42ff-b205-3721eae2dce8 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.471308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5095f4-5bd1-4f4c-b157-1da4f75aa8be None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.485968 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.486567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.486846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.487114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.512089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.512929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.513049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.513237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.513928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:52.514234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.515801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.529084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 542/1080] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:52.534881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.546213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.557882 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.560597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.566260 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.640429 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9cab8-1c4b-4dec-8bfa-7a628b08edb1 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.677042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.677716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.677986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.678263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/1276878b8f0541398e54be24543abd85/roles/8ff9dd1a3c8e4d699dbdfa73ce6a3107` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.678814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 539/1081] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:52.680481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=1276878b8f0541398e54be24543abd85, role_id=8ff9dd1a3c8e4d699dbdfa73ce6a3107)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.681918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.684573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.763187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 543/1082] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:27:52 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/1276878b8f0541398e54be24543abd85/roles/8ff9dd1a3c8e4d699dbdfa73ce6a3107 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:27:52.787131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.790790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adcdc-dbfe-4ded-b768-409e518093d1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:52.830168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c0db-32fd-4048-909c-c1a1d07f9dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:52.830825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c0db-32fd-4048-909c-c1a1d07f9dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:52.831102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c0db-32fd-4048-909c-c1a1d07f9dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:52.831425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c0db-32fd-4048-909c-c1a1d07f9dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:52.842802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c0db-32fd-4048-909c-c1a1d07f9dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:52.844892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c0db-32fd-4048-909c-c1a1d07f9dd2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-2c51c0db-32fd-4048-909c-c1a1d07f9dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:52.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:52.862794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:52.864288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:52.864288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:52.864288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:52.864288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 540/1083] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:52.869055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:52.946366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:52.980043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1523da-2529-4bf5-a346-dfd7c25e438e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:53.016238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c9c03-4a99-4c52-917f-7036aa59dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:53.016843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c9c03-4a99-4c52-917f-7036aa59dfdd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:53.017121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c9c03-4a99-4c52-917f-7036aa59dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:53.017391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c9c03-4a99-4c52-917f-7036aa59dfdd None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:53.018035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c9c03-4a99-4c52-917f-7036aa59dfdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:53.018335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c9c03-4a99-4c52-917f-7036aa59dfdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:53.019745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c9c03-4a99-4c52-917f-7036aa59dfdd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:53.039278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 544/1084] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:54.236884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa23165-ee52-4a9d-8451-17685483cee8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:54.237600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa23165-ee52-4a9d-8451-17685483cee8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:54.237600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa23165-ee52-4a9d-8451-17685483cee8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:54.238942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 541/1085] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:54.244593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce196ae-b19e-471e-ac30-0b50ef5cfc20 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:54.245028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce196ae-b19e-471e-ac30-0b50ef5cfc20 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:54.245259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce196ae-b19e-471e-ac30-0b50ef5cfc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:54.263859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0ce196ae-b19e-471e-ac30-0b50ef5cfc20 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:54.265036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0ce196ae-b19e-471e-ac30-0b50ef5cfc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:54.332305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 545/1086] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:54.599334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa23165-ee52-4a9d-8451-17685483cee8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:54.668040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08e88-7bd3-450d-9924-5356d5333974 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:54.668324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08e88-7bd3-450d-9924-5356d5333974 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:54.668596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08e88-7bd3-450d-9924-5356d5333974 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:54.669941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 546/1087] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:54.675217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6687-7284-467d-a74e-56f6e0b56bba None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:54.675502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6687-7284-467d-a74e-56f6e0b56bba None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:54.675774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6687-7284-467d-a74e-56f6e0b56bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:54.693890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b24a6687-7284-467d-a74e-56f6e0b56bba None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:54.695085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b24a6687-7284-467d-a74e-56f6e0b56bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:54.710381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa23165-ee52-4a9d-8451-17685483cee8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:54.748225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:54.748848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:54.749127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:54.749401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:54.751212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:54.760318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:54.764867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 547/1088] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:54.765090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:54.767311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:54.768200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 542/1089] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:27:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:54.772464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6687-7284-467d-a74e-56f6e0b56bba None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:54.868467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6687-7284-467d-a74e-56f6e0b56bba None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:54.901497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:54.902093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:54.902372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:54.902645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:54.903334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:54.903637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:54.905001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:54.912846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 548/1090] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:27:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:54.918415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:54.933813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.019631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd8ae1-6524-423d-95c7-c9ef299646dd None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.045630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.054750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.055464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.055743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.056015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] PATH_INFO: `/v3/users/d3ebbb3c1e2e40939f4d30b8d2e79d22` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.057150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d3ebbb3c1e2e40939f4d30b8d2e79d22)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.058585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.060196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 543/1091] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:27:54 2022] GET /identity/v3/users/d3ebbb3c1e2e40939f4d30b8d2e79d22 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:55.065798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.096045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.145409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.146245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cf712-efed-4d08-9798-804ccd03e522 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.164359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941579-3f86-451d-ad37-c22266e935f1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.179783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.180399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.180672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.180935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.190830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:27:55.196329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:55.197381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:55.198756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 549/1092] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:55.199645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.199645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.199832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.199992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.203412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.334421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.335904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.366830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867856d0-33ff-4146-bf52-66c42b717849 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.376926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.401019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.401541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.401813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.402076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.402717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:55.403010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.404389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.413224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 550/1093] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:55.416055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.418922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.440799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 544/1094] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:27:55.441806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.516908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4600a-7dfc-4c58-8133-5e795bca5f90 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.541704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0482dc-90d3-4304-bcde-e811b85b38aa None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.550297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.550925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.551242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.551514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.561376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.563428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.575620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.576232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.576504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.576804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:55.577808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:55.578878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:55.579816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:55.579816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:55.579816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:55.580013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.580094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 551/1095] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:27:55.580165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.583180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 545/1096] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:55.584875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.586699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.610130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.634348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.685246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc387c-3964-45b0-8435-302228c9e785 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.685681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccc825-591c-4c06-a94f-27ad2426a484 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.718931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.719131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.719571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.719698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.719848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.719975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.720115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.720246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.720755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:55.720959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56, user.id=d3ebbb3c1e2e40939f4d30b8d2e79d22) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:55.721070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.721260 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.722393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.722659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.728298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 546/1097] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/role_assignments?user.id=d3ebbb3c1e2e40939f4d30b8d2e79d22&scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:55.734666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 552/1098] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:27:55.740791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.845586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18cfce-cd31-47cb-9ab9-64bf8ef31e29 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:55.858920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.881631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:55.882263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.882545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.882816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.891762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:55.893205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:27:55.904487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:55.905509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:27:55.906533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 547/1099] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:55.911454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:55.996652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:56.012000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a7a57-5c32-45f7-bc00-ca321ff4a35a None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:56.046105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:56.046783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:56.047055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:56.047349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:56.048573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:56.048872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:56.050284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:56.067168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 553/1100] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 1 16:27:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:56.072955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:56.169616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25432ce-eccd-4f21-b8e1-d81d9c8c1b9d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:56.202482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:56.203124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:56.203425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:56.203689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:56.242950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:56.268146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:56.269656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:56.364777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 548/1101] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:27:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:56.370521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:56.465452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27c5e7-c680-403e-aa00-3908c2551344 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:56.498642 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:56.499277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:56.500095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:56.500375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:56.509872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:56.511322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:56.512940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:27:56.528369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:56.534612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:27:56.535611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:27:56.535611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:27:56.535611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:56.535611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 554/1102] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:56.535847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:56.603548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:56.632214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555e8c-7139-4948-aee6-f8d583d2ece2 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:56.667118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:56.667739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:56.668009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:56.668275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:56.668903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:56.669205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:56.670602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:56.681982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 549/1103] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:56.687695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:56.784558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae532a15-de1a-4df1-877b-ba984c3bbd58 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:56.818605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:56.819278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:56.819554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:56.819820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:56.827089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:56.828643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:27:56.840634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:27:56.841730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:27:56.847988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 555/1104] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:27:56.848470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:56.945557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40746c8e-3dcb-40ec-98b7-66d2cfc65d5a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:56.972587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:56.977269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90dd14-14b2-4d5b-9f34-11ab0ce935de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:56.977856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90dd14-14b2-4d5b-9f34-11ab0ce935de None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:56.978127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90dd14-14b2-4d5b-9f34-11ab0ce935de None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:56.978392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90dd14-14b2-4d5b-9f34-11ab0ce935de None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:56.979067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90dd14-14b2-4d5b-9f34-11ab0ce935de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:56.979397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90dd14-14b2-4d5b-9f34-11ab0ce935de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:56.980806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90dd14-14b2-4d5b-9f34-11ab0ce935de None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:56.992766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 550/1105] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:56.998878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:57.054910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:57.099609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74047ca-ad78-4701-b6bf-c2e9cdb0da66 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:57.133626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a6fc9-4834-478f-8d40-ea325948a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:57.134229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6fc9-4834-478f-8d40-ea325948a692 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:57.134505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6fc9-4834-478f-8d40-ea325948a692 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:57.134777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a6fc9-4834-478f-8d40-ea325948a692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:57.135533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a6fc9-4834-478f-8d40-ea325948a692 None admin] RBAC: Adding query filter params (role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=1276878b8f0541398e54be24543abd85) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:27:57.135840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a6fc9-4834-478f-8d40-ea325948a692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:57.137263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a6fc9-4834-478f-8d40-ea325948a692 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:57.143068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 556/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:27:56 2022] GET /identity/v3/role_assignments?user.id=1276878b8f0541398e54be24543abd85&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=8ff9dd1a3c8e4d699dbdfa73ce6a3107 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:57.666262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede483b-0252-4207-b4e4-0c95e739dc7b None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:57.666755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede483b-0252-4207-b4e4-0c95e739dc7b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:57.666853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede483b-0252-4207-b4e4-0c95e739dc7b None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:57.668191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 551/1107] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:57.673590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86a56-767b-41a3-9ee2-02ab6151ece0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:57.674017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86a56-767b-41a3-9ee2-02ab6151ece0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:57.674125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86a56-767b-41a3-9ee2-02ab6151ece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:57.692342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0fd86a56-767b-41a3-9ee2-02ab6151ece0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:57.693534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0fd86a56-767b-41a3-9ee2-02ab6151ece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:57.761699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 557/1108] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:27:58.039965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede483b-0252-4207-b4e4-0c95e739dc7b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:58.142161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede483b-0252-4207-b4e4-0c95e739dc7b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:58.175473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290b98a-550c-4ef6-95a6-2956adf8a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:58.176092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b98a-550c-4ef6-95a6-2956adf8a46a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:58.176369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b98a-550c-4ef6-95a6-2956adf8a46a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:58.176637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b98a-550c-4ef6-95a6-2956adf8a46a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:58.177814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290b98a-550c-4ef6-95a6-2956adf8a46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:58.179275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290b98a-550c-4ef6-95a6-2956adf8a46a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:58.180847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 552/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:27:58.186585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd86a56-767b-41a3-9ee2-02ab6151ece0 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:58.234007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:58.285616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd86a56-767b-41a3-9ee2-02ab6151ece0 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:58.323111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd3dbd-d98a-4134-b691-9028a326036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:58.323649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3dbd-d98a-4134-b691-9028a326036f None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:58.323925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3dbd-d98a-4134-b691-9028a326036f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:58.324192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3dbd-d98a-4134-b691-9028a326036f None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:58.324840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd3dbd-d98a-4134-b691-9028a326036f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:58.326261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd3dbd-d98a-4134-b691-9028a326036f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:58.408207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 558/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:27:58 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:28:00.334764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fe24-90bd-4f34-b837-3f1c624e73d7 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:00.335315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fe24-90bd-4f34-b837-3f1c624e73d7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:00.335315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33fe24-90bd-4f34-b837-3f1c624e73d7 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:00.336675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 553/1111] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:00.341840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fef15-fdbb-425e-9b79-72e829bb4fef None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:00.342216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fef15-fdbb-425e-9b79-72e829bb4fef None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:00.342396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fef15-fdbb-425e-9b79-72e829bb4fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:00.360168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e02fef15-fdbb-425e-9b79-72e829bb4fef None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:00.361357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e02fef15-fdbb-425e-9b79-72e829bb4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:00.426595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 559/1112] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:00.694734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33fe24-90bd-4f34-b837-3f1c624e73d7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:00.752896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:00.792310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33fe24-90bd-4f34-b837-3f1c624e73d7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:00.825740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:00.826344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:00.826617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:00.826910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] PATH_INFO: `/v3/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:00.828319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] RBAC: Authorizing `identity:get_role(role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:00.829675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:00.830963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 554/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:00 2022] GET /identity/v3/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:00.836695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fef15-fdbb-425e-9b79-72e829bb4fef None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:00.870458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:00.934334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fef15-fdbb-425e-9b79-72e829bb4fef None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:00.966991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:00.967626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:00.967906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:00.968204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] PATH_INFO: `/v3/users/adbb71d970f74fa98679a25eb58d05f7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:00.980606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] RBAC: Authorizing `identity:get_user(user_id=adbb71d970f74fa98679a25eb58d05f7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:00.982044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:00.984300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 560/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:00 2022] GET /identity/v3/users/adbb71d970f74fa98679a25eb58d05f7 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:00.989881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:01.086956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12784d-af3f-4dd1-a622-d61dd184ff15 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:01.112851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:01.120224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:01.120804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:01.121075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:01.129628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:01.188300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:01.189802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:01.284041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 555/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:28:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:01.290129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:01.379102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:01.387470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ef21-bc90-4dbb-9149-1e91f06607c2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:01.421060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208247e-ea7b-476e-814e-cd7ebeeff73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:01.422218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208247e-ea7b-476e-814e-cd7ebeeff73f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:01.422496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208247e-ea7b-476e-814e-cd7ebeeff73f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:01.422760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208247e-ea7b-476e-814e-cd7ebeeff73f None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:01.423888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208247e-ea7b-476e-814e-cd7ebeeff73f None admin] RBAC: Authorizing `identity:get_project(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:01.425305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208247e-ea7b-476e-814e-cd7ebeeff73f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:01.426909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 561/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:01 2022] GET /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:01.433297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:01.460646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:01.528746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6d7a-8e97-416c-9705-ec10d2d243a3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:01.561275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e42fc0-65d4-4145-aae7-0a27ee890cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:01.562431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e42fc0-65d4-4145-aae7-0a27ee890cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:01.562707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e42fc0-65d4-4145-aae7-0a27ee890cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:01.562974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e42fc0-65d4-4145-aae7-0a27ee890cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:01.563859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e42fc0-65d4-4145-aae7-0a27ee890cd8 None admin] RBAC: Adding query filter params (role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56, user.id=adbb71d970f74fa98679a25eb58d05f7) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:01.564161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e42fc0-65d4-4145-aae7-0a27ee890cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:01.565565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e42fc0-65d4-4145-aae7-0a27ee890cd8 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:01.570737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 556/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:28:01 2022] GET /identity/v3/role_assignments?user.id=adbb71d970f74fa98679a25eb58d05f7&scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:03.427763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b6d88-6342-499d-98a9-357ba668c140 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:03.428397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b6d88-6342-499d-98a9-357ba668c140 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:03.428397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b6d88-6342-499d-98a9-357ba668c140 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:03.429639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 562/1118] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:03.434629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ee20-bf25-49a8-b13d-11891e92ba27 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:03.435072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ee20-bf25-49a8-b13d-11891e92ba27 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:03.435216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ee20-bf25-49a8-b13d-11891e92ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:03.453977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0ee3ee20-bf25-49a8-b13d-11891e92ba27 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:03.455185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0ee3ee20-bf25-49a8-b13d-11891e92ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:03.518506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 557/1119] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:03.783929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b6d88-6342-499d-98a9-357ba668c140 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:03.881031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b6d88-6342-499d-98a9-357ba668c140 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:03.914169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:03.914772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:03.915046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:03.915363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] PATH_INFO: `/v3/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:03.916725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] RBAC: Authorizing `identity:get_role(role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:03.918071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:03.919381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 563/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:03 2022] GET /identity/v3/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:03.925448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3ee20-bf25-49a8-b13d-11891e92ba27 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:03.948643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:04.019631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3ee20-bf25-49a8-b13d-11891e92ba27 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:04.052049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:04.052598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:04.052869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:04.053133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] PATH_INFO: `/v3/users/adbb71d970f74fa98679a25eb58d05f7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:04.054234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] RBAC: Authorizing `identity:get_user(user_id=adbb71d970f74fa98679a25eb58d05f7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:04.055668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:04.057209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 558/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:03 2022] GET /identity/v3/users/adbb71d970f74fa98679a25eb58d05f7 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:04.063271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:04.091236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:04.159333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0902d7-da7a-4d09-8d1d-56d764e1b35c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:04.191631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff057ba3-f73c-4c7d-8ac4-8e1cc54ac8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:04.192241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057ba3-f73c-4c7d-8ac4-8e1cc54ac8ea None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:04.192515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057ba3-f73c-4c7d-8ac4-8e1cc54ac8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:04.192783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff057ba3-f73c-4c7d-8ac4-8e1cc54ac8ea None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:04.193879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff057ba3-f73c-4c7d-8ac4-8e1cc54ac8ea None admin] RBAC: Authorizing `identity:get_project(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:04.195310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff057ba3-f73c-4c7d-8ac4-8e1cc54ac8ea None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:04.196903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 564/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:04 2022] GET /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:04.203173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:04.291898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:04.300884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba7eb-e0c4-4bc1-b3c4-af75a3b9be7a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:04.333972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115d53-31d2-4f88-bc3f-022a1985af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:04.334546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115d53-31d2-4f88-bc3f-022a1985af0e None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:04.334822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115d53-31d2-4f88-bc3f-022a1985af0e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:04.335089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115d53-31d2-4f88-bc3f-022a1985af0e None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56/users/adbb71d970f74fa98679a25eb58d05f7/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:04.337213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115d53-31d2-4f88-bc3f-022a1985af0e None admin] RBAC: Authorizing `identity:create_grant(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56, user_id=adbb71d970f74fa98679a25eb58d05f7, role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:04.338628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115d53-31d2-4f88-bc3f-022a1985af0e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:04.429544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 559/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:28:04 2022] PUT /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56/users/adbb71d970f74fa98679a25eb58d05f7/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:28:06.308924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d442a0-d232-4674-adeb-6d3a51183e50 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.309474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d442a0-d232-4674-adeb-6d3a51183e50 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.309474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d442a0-d232-4674-adeb-6d3a51183e50 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.310828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 565/1124] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:06.341563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b855-b127-401e-b2fb-05d28ab20a05 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.341563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b855-b127-401e-b2fb-05d28ab20a05 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.341563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b855-b127-401e-b2fb-05d28ab20a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.341563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5b66b855-b127-401e-b2fb-05d28ab20a05 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:06.341563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5b66b855-b127-401e-b2fb-05d28ab20a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:06.404017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 560/1125] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:06.676118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d442a0-d232-4674-adeb-6d3a51183e50 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:06.767501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:06.774493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d442a0-d232-4674-adeb-6d3a51183e50 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:06.820592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:06.821210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.821484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.821750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] PATH_INFO: `/v3/roles/c70b2e0d045d45ba8f33e371e4649c47` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.823108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] RBAC: Authorizing `identity:get_role(role_id=c70b2e0d045d45ba8f33e371e4649c47)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:06.824493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:06.825805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 566/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:06 2022] GET /identity/v3/roles/c70b2e0d045d45ba8f33e371e4649c47 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:06.832248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b855-b127-401e-b2fb-05d28ab20a05 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:06.912044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:06.930513 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b855-b127-401e-b2fb-05d28ab20a05 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:06.963440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:06.964173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.964449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.964716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] PATH_INFO: `/v3/users/adbb71d970f74fa98679a25eb58d05f7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.965810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] RBAC: Authorizing `identity:get_user(user_id=adbb71d970f74fa98679a25eb58d05f7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:06.967303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:06.968902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 561/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:06 2022] GET /identity/v3/users/adbb71d970f74fa98679a25eb58d05f7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:06.974622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:07.071848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd22072-dfd4-42a9-af94-4ea915c66dac None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:07.105367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:07.105955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:07.106232 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:07.106502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:07.136259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:07.176134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:07.177526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:07.272454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 567/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:28:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:07.278374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:07.374652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77a5b7-5ebd-4294-898c-7620a5de9aca None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:07.408220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05847a-ffa5-49b7-bbec-1501d3e0ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:07.408826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05847a-ffa5-49b7-bbec-1501d3e0ce70 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:07.409102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05847a-ffa5-49b7-bbec-1501d3e0ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:07.409372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05847a-ffa5-49b7-bbec-1501d3e0ce70 None admin] PATH_INFO: `/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:07.410489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05847a-ffa5-49b7-bbec-1501d3e0ce70 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1bd651f3b94cd5b15f9ad9621a6d56)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:07.411977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05847a-ffa5-49b7-bbec-1501d3e0ce70 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:07.413590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 562/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:07 2022] GET /identity/v3/projects/ff1bd651f3b94cd5b15f9ad9621a6d56 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:07.419776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:07.479827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:07.517668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac045e-117a-49b9-96af-d8abb7eb6065 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:07.550425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860560b9-81ac-49e7-b85b-fcf91c5d9299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:07.550994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860560b9-81ac-49e7-b85b-fcf91c5d9299 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:07.551304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860560b9-81ac-49e7-b85b-fcf91c5d9299 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:07.551571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860560b9-81ac-49e7-b85b-fcf91c5d9299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:07.552282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860560b9-81ac-49e7-b85b-fcf91c5d9299 None admin] RBAC: Adding query filter params (role.id=c70b2e0d045d45ba8f33e371e4649c47, scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56, user.id=adbb71d970f74fa98679a25eb58d05f7) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:07.552583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860560b9-81ac-49e7-b85b-fcf91c5d9299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:07.553989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860560b9-81ac-49e7-b85b-fcf91c5d9299 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:07.559548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 568/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:28:07 2022] GET /identity/v3/role_assignments?user.id=adbb71d970f74fa98679a25eb58d05f7&scope.project.id=ff1bd651f3b94cd5b15f9ad9621a6d56&role.id=c70b2e0d045d45ba8f33e371e4649c47 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:28:09.475562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ad96d-a766-4f1e-a82f-445e08009796 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:09.476114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ad96d-a766-4f1e-a82f-445e08009796 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:09.476114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ad96d-a766-4f1e-a82f-445e08009796 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:09.477591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 563/1131] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:09.482584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e247fd-fb04-4605-adcb-c13a208bcaae None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:09.483011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e247fd-fb04-4605-adcb-c13a208bcaae None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:09.483112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e247fd-fb04-4605-adcb-c13a208bcaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:09.501307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e9e247fd-fb04-4605-adcb-c13a208bcaae None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:09.502473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e9e247fd-fb04-4605-adcb-c13a208bcaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:09.569523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 569/1132] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:09.844463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ad96d-a766-4f1e-a82f-445e08009796 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:09.862195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:09.943450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ad96d-a766-4f1e-a82f-445e08009796 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:09.975459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df129400-2e93-43bb-82c8-5ef442310876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:09.976069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df129400-2e93-43bb-82c8-5ef442310876 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:09.976344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df129400-2e93-43bb-82c8-5ef442310876 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:09.976614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df129400-2e93-43bb-82c8-5ef442310876 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:09.977717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df129400-2e93-43bb-82c8-5ef442310876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:09.979174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df129400-2e93-43bb-82c8-5ef442310876 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:09.980731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 564/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:09.987139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e247fd-fb04-4605-adcb-c13a208bcaae None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:10.043146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:10.082421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e247fd-fb04-4605-adcb-c13a208bcaae None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:10.115744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ecb84-9680-423a-9b76-1aa14f42ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:10.116256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ecb84-9680-423a-9b76-1aa14f42ee67 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:10.116531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ecb84-9680-423a-9b76-1aa14f42ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:10.116799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ecb84-9680-423a-9b76-1aa14f42ee67 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:10.117444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ecb84-9680-423a-9b76-1aa14f42ee67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:10.118853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ecb84-9680-423a-9b76-1aa14f42ee67 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:10.204102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 570/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:28:09 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:28:12.136058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1835a7-6c8e-48d4-b979-1df6e6f95938 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:12.136579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1835a7-6c8e-48d4-b979-1df6e6f95938 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:12.136579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1835a7-6c8e-48d4-b979-1df6e6f95938 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:12.137958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 565/1135] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:12.143117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b5d6-9c86-4546-9b19-ca151fbc9d22 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:12.143554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b5d6-9c86-4546-9b19-ca151fbc9d22 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:12.143689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863b5d6-9c86-4546-9b19-ca151fbc9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:12.161591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5863b5d6-9c86-4546-9b19-ca151fbc9d22 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:12.162766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5863b5d6-9c86-4546-9b19-ca151fbc9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:12.227644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 571/1136] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:12.504139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1835a7-6c8e-48d4-b979-1df6e6f95938 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:12.586511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:12.601878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1835a7-6c8e-48d4-b979-1df6e6f95938 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:12.634281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c20f3-dcc1-4164-912b-0812bce1d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:12.634890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c20f3-dcc1-4164-912b-0812bce1d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:12.635186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c20f3-dcc1-4164-912b-0812bce1d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:12.635465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c20f3-dcc1-4164-912b-0812bce1d9a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:12.636565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c20f3-dcc1-4164-912b-0812bce1d9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:12.637984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c20f3-dcc1-4164-912b-0812bce1d9a3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:12.640119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 566/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:28:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:12.646193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b5d6-9c86-4546-9b19-ca151fbc9d22 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:12.685867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:12.741037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863b5d6-9c86-4546-9b19-ca151fbc9d22 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:12.776091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d939b-c14d-422f-b591-5b41708c355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:12.776685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d939b-c14d-422f-b591-5b41708c355a None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:12.776958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d939b-c14d-422f-b591-5b41708c355a None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:12.777227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d939b-c14d-422f-b591-5b41708c355a None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:12.777864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d939b-c14d-422f-b591-5b41708c355a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:12.779296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d939b-c14d-422f-b591-5b41708c355a None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:12.867614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 572/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:28:12 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:28:14.779065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03ac05-a378-46df-a4d5-ddba52e7bff1 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:14.779645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03ac05-a378-46df-a4d5-ddba52e7bff1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:14.779645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03ac05-a378-46df-a4d5-ddba52e7bff1 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:14.781509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 567/1139] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:14.786560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ea265-cbfd-4951-9360-0d72a937657b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:14.786993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ea265-cbfd-4951-9360-0d72a937657b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:14.787129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ea265-cbfd-4951-9360-0d72a937657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:14.805891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c02ea265-cbfd-4951-9360-0d72a937657b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:14.807086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c02ea265-cbfd-4951-9360-0d72a937657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:14.870798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 573/1140] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:15.136989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03ac05-a378-46df-a4d5-ddba52e7bff1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:15.236554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03ac05-a378-46df-a4d5-ddba52e7bff1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:15.269322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:15.269933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:15.270218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:15.270741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:15.281090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:28:15.285856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:28:15.287114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:28:15.288077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 568/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:28:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:28:15.292873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ea265-cbfd-4951-9360-0d72a937657b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:15.319378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:15.390849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ea265-cbfd-4951-9360-0d72a937657b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:15.424163 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:15.424760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:15.425037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:15.425307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:15.425960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:15.426259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:15.427647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:15.435388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 574/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:15.441329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:15.456305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:15.538325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4c18c-595b-4b84-9852-4579dca5cd83 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:15.570742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:15.571376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:15.571653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:15.571923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] PATH_INFO: `/v3/users/11fc4a910f6543919c1cc59130518b20` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:15.584415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] RBAC: Authorizing `identity:get_user(user_id=11fc4a910f6543919c1cc59130518b20)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:15.585850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:15.587457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 569/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:15 2022] GET /identity/v3/users/11fc4a910f6543919c1cc59130518b20 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:15.593942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:15.680616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:15.691931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599394e-a0c7-4213-916e-beeb67b5d76c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:15.725013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:15.725600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:15.725872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:15.726134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:15.790011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:15.791467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:15.874618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:15.886766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 575/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:28:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:15.892957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:15.959103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:15.987737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ff354-5688-43df-b119-65a737b08b88 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:16.020257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873a084-bde1-4466-9dcc-ff87d2489122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:16.021115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a084-bde1-4466-9dcc-ff87d2489122 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:16.021386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a084-bde1-4466-9dcc-ff87d2489122 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:16.021652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a084-bde1-4466-9dcc-ff87d2489122 None admin] PATH_INFO: `/v3/projects/f7a1a3017dea40bb823ac142af9a68c1` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:16.022757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873a084-bde1-4466-9dcc-ff87d2489122 None admin] RBAC: Authorizing `identity:get_project(project_id=f7a1a3017dea40bb823ac142af9a68c1)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:16.024221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873a084-bde1-4466-9dcc-ff87d2489122 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:16.025816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 570/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:15 2022] GET /identity/v3/projects/f7a1a3017dea40bb823ac142af9a68c1 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:16.032466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:16.128450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451030b-1dc6-4497-9a9d-ee4c75667e94 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:16.161251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49389-c5d6-4667-8f1c-8edab43af264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:16.161836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49389-c5d6-4667-8f1c-8edab43af264 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:16.162111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49389-c5d6-4667-8f1c-8edab43af264 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:16.162378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49389-c5d6-4667-8f1c-8edab43af264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:16.163090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49389-c5d6-4667-8f1c-8edab43af264 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f7a1a3017dea40bb823ac142af9a68c1, user.id=11fc4a910f6543919c1cc59130518b20) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:16.163423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49389-c5d6-4667-8f1c-8edab43af264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:16.164830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49389-c5d6-4667-8f1c-8edab43af264 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:16.169986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 576/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:28:16 2022] GET /identity/v3/role_assignments?user.id=11fc4a910f6543919c1cc59130518b20&scope.project.id=f7a1a3017dea40bb823ac142af9a68c1&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:18.040497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33d7c3-20c1-4376-96d3-b42c582cac78 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.041019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33d7c3-20c1-4376-96d3-b42c582cac78 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.041019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33d7c3-20c1-4376-96d3-b42c582cac78 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.042384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 571/1147] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:18.047960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff418ea-4d2b-4f01-b7f4-537585721ac9 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.048401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff418ea-4d2b-4f01-b7f4-537585721ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.048504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff418ea-4d2b-4f01-b7f4-537585721ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.066595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-cff418ea-4d2b-4f01-b7f4-537585721ac9 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:18.067799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cff418ea-4d2b-4f01-b7f4-537585721ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:18.112254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:18.131652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 577/1148] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:18.399790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33d7c3-20c1-4376-96d3-b42c582cac78 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:18.497903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33d7c3-20c1-4376-96d3-b42c582cac78 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:18.530436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:18.531034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.531336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.531602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.537969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:18.541419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:28:18.546759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:28:18.564999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:28:18.566062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 572/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:28:18.566934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff418ea-4d2b-4f01-b7f4-537585721ac9 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:18.656531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff418ea-4d2b-4f01-b7f4-537585721ac9 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:18.688703 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:18.689292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.689564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.689827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.690474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:18.690770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:18.692141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:18.699795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 578/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:18.706072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:18.802354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdd825-2062-47d9-908a-1eeeb29f897d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:18.839964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:18.840573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.840851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.841124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] PATH_INFO: `/v3/users/11fc4a910f6543919c1cc59130518b20` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.842837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=11fc4a910f6543919c1cc59130518b20)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:18.847039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:18.848629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 573/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:18 2022] GET /identity/v3/users/11fc4a910f6543919c1cc59130518b20 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:18.854309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:18.900994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:18.953822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d6d6-03e4-4012-85c8-2d9fcc087692 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:18.986532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2a5a-4bff-44b4-9b6c-8257c0deac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:18.987143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a5a-4bff-44b4-9b6c-8257c0deac41 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.987456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a5a-4bff-44b4-9b6c-8257c0deac41 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.987723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a5a-4bff-44b4-9b6c-8257c0deac41 None admin] PATH_INFO: `/v3/projects/f7a1a3017dea40bb823ac142af9a68c1` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.988817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2a5a-4bff-44b4-9b6c-8257c0deac41 None admin] RBAC: Authorizing `identity:get_project(project_id=f7a1a3017dea40bb823ac142af9a68c1)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:18.990229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2a5a-4bff-44b4-9b6c-8257c0deac41 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:18.991856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 579/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:18 2022] GET /identity/v3/projects/f7a1a3017dea40bb823ac142af9a68c1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:18.997721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:19.062282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:19.095454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6574dd7-0c85-4a77-a08a-737acb0e2dc0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:19.128474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d59cb-9f6e-410c-a56d-12f1cc255c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:19.129110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d59cb-9f6e-410c-a56d-12f1cc255c5f None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:19.129388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d59cb-9f6e-410c-a56d-12f1cc255c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:19.129661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d59cb-9f6e-410c-a56d-12f1cc255c5f None admin] PATH_INFO: `/v3/projects/f7a1a3017dea40bb823ac142af9a68c1/users/11fc4a910f6543919c1cc59130518b20/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:19.131566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d59cb-9f6e-410c-a56d-12f1cc255c5f None admin] RBAC: Authorizing `identity:create_grant(project_id=f7a1a3017dea40bb823ac142af9a68c1, user_id=11fc4a910f6543919c1cc59130518b20, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:19.133067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d59cb-9f6e-410c-a56d-12f1cc255c5f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:19.205886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 574/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:28:18 2022] PUT /identity/v3/projects/f7a1a3017dea40bb823ac142af9a68c1/users/11fc4a910f6543919c1cc59130518b20/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:28:21.075925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce0f44-dde1-44d5-a53b-6681bc2e1794 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.076532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce0f44-dde1-44d5-a53b-6681bc2e1794 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.076532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce0f44-dde1-44d5-a53b-6681bc2e1794 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.077852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 580/1154] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:21.083124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f8914-9d49-4121-8f6b-f097ace120d2 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.083551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f8914-9d49-4121-8f6b-f097ace120d2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.083701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f8914-9d49-4121-8f6b-f097ace120d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.101413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ad9f8914-9d49-4121-8f6b-f097ace120d2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:21.102591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ad9f8914-9d49-4121-8f6b-f097ace120d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:21.167335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 575/1155] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:21.439513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce0f44-dde1-44d5-a53b-6681bc2e1794 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:21.538025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce0f44-dde1-44d5-a53b-6681bc2e1794 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:21.550639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:21.569912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:21.570517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.570819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.571085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.581088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:28:21.586154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:28:21.587065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:28:21.588011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 581/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:28:21.593894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f8914-9d49-4121-8f6b-f097ace120d2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:21.650989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:21.694345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f8914-9d49-4121-8f6b-f097ace120d2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:21.726932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:21.727552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.727827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.728090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.728737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:21.729033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:21.730379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:21.738042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 576/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:28:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:21.743846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:21.840234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506cb30-4eab-4ea3-a677-691de215d449 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:21.872139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:21.872755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.873032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.873883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] PATH_INFO: `/v3/users/11fc4a910f6543919c1cc59130518b20` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.874996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] RBAC: Authorizing `identity:get_user(user_id=11fc4a910f6543919c1cc59130518b20)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:21.876450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:21.877993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 582/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:21 2022] GET /identity/v3/users/11fc4a910f6543919c1cc59130518b20 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:21.883823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:21.987061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77238a93-39f8-42f9-8969-7aec3078d43c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:22.004859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:22.022088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:22.022684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:22.022962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:22.023267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:22.091349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:22.093310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:22.188039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 577/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:28:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:22.193968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:22.235475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:22.291861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64404-adf0-4d25-943b-6fa73ed35f71 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:22.328917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c45b45-06bd-41f2-81ca-616d64bc1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:22.329535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c45b45-06bd-41f2-81ca-616d64bc1779 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:22.329814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c45b45-06bd-41f2-81ca-616d64bc1779 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:22.330086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c45b45-06bd-41f2-81ca-616d64bc1779 None admin] PATH_INFO: `/v3/projects/f7a1a3017dea40bb823ac142af9a68c1` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:22.331219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c45b45-06bd-41f2-81ca-616d64bc1779 None admin] RBAC: Authorizing `identity:get_project(project_id=f7a1a3017dea40bb823ac142af9a68c1)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:22.332636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c45b45-06bd-41f2-81ca-616d64bc1779 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:22.334251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 583/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:22 2022] GET /identity/v3/projects/f7a1a3017dea40bb823ac142af9a68c1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:22.340386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:22.358980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:22.438621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e36d3-4b1b-46b5-a841-e5b66eb65c4c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:22.470614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7aaea-6b0d-4ee9-834c-1df6c8a15096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:22.471221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7aaea-6b0d-4ee9-834c-1df6c8a15096 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:22.471503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7aaea-6b0d-4ee9-834c-1df6c8a15096 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:22.471773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7aaea-6b0d-4ee9-834c-1df6c8a15096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:22.472485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7aaea-6b0d-4ee9-834c-1df6c8a15096 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f7a1a3017dea40bb823ac142af9a68c1, user.id=11fc4a910f6543919c1cc59130518b20) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:22.472791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7aaea-6b0d-4ee9-834c-1df6c8a15096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:22.474225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7aaea-6b0d-4ee9-834c-1df6c8a15096 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:22.479826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 578/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:28:22 2022] GET /identity/v3/role_assignments?user.id=11fc4a910f6543919c1cc59130518b20&scope.project.id=f7a1a3017dea40bb823ac142af9a68c1&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:24.400729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee309-68b1-4681-a520-2c6ef2ec4932 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.401262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee309-68b1-4681-a520-2c6ef2ec4932 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.401262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee309-68b1-4681-a520-2c6ef2ec4932 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.402620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 584/1162] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:24.408367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8e7a-f7b1-42a4-8da3-99b3578a5439 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.408801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8e7a-f7b1-42a4-8da3-99b3578a5439 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.408896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8e7a-f7b1-42a4-8da3-99b3578a5439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.427076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-770f8e7a-f7b1-42a4-8da3-99b3578a5439 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:24.428295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-770f8e7a-f7b1-42a4-8da3-99b3578a5439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:24.491443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 579/1163] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:24.758382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee309-68b1-4681-a520-2c6ef2ec4932 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:24.857037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee309-68b1-4681-a520-2c6ef2ec4932 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:24.865980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:24.889832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:24.890425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.890702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.890973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.955676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:24.957114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:25.051912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 585/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:28:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:25.057813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8e7a-f7b1-42a4-8da3-99b3578a5439 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:25.071397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.155048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8e7a-f7b1-42a4-8da3-99b3578a5439 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:25.189292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbff17-36ba-4cda-b07a-8b00582906d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:25.189914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbff17-36ba-4cda-b07a-8b00582906d5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:25.190225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbff17-36ba-4cda-b07a-8b00582906d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:25.190489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbff17-36ba-4cda-b07a-8b00582906d5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:25.197072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbff17-36ba-4cda-b07a-8b00582906d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:25.198501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbff17-36ba-4cda-b07a-8b00582906d5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-cabbff17-36ba-4cda-b07a-8b00582906d5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:28:25.209657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:28:25.210819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:28:25.211723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 580/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:28:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:28:25.217487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:25.227466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.314895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d25b5-e328-4794-82b0-27effecad1b5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:25.347835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77725221-f673-482c-8c01-5c362c985632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:25.348423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725221-f673-482c-8c01-5c362c985632 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:25.348701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725221-f673-482c-8c01-5c362c985632 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:25.348971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725221-f673-482c-8c01-5c362c985632 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:25.349606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77725221-f673-482c-8c01-5c362c985632 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:25.349908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77725221-f673-482c-8c01-5c362c985632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:25.351287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77725221-f673-482c-8c01-5c362c985632 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:25.358199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 586/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 1 16:28:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:27.225367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51e1a9-5d40-472a-859c-e9cd0c8934a4 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:27.225916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51e1a9-5d40-472a-859c-e9cd0c8934a4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:27.225916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51e1a9-5d40-472a-859c-e9cd0c8934a4 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:27.227276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 581/1167] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:27.233440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de125b83-f7d3-42ab-82bc-0a7665b8f0dc None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:27.233864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de125b83-f7d3-42ab-82bc-0a7665b8f0dc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:27.234007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de125b83-f7d3-42ab-82bc-0a7665b8f0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:27.252795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-de125b83-f7d3-42ab-82bc-0a7665b8f0dc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:27.253971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-de125b83-f7d3-42ab-82bc-0a7665b8f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:27.318916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 587/1168] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:27.584452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51e1a9-5d40-472a-859c-e9cd0c8934a4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:27.656069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:27.685702 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51e1a9-5d40-472a-859c-e9cd0c8934a4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:27.718396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a302d94-6ace-41c4-b39f-30c4efc8142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:27.718982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302d94-6ace-41c4-b39f-30c4efc8142c None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:27.719289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302d94-6ace-41c4-b39f-30c4efc8142c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:27.719564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a302d94-6ace-41c4-b39f-30c4efc8142c None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:27.720243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a302d94-6ace-41c4-b39f-30c4efc8142c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:27.721605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a302d94-6ace-41c4-b39f-30c4efc8142c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:27.788539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 582/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Thu Sep 1 16:28:27 2022] POST /identity/v3/domains => generated 267 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:28:29.709459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90311d-a2be-4d93-8522-e2e18e0d0e14 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:29.709943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90311d-a2be-4d93-8522-e2e18e0d0e14 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:29.710058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90311d-a2be-4d93-8522-e2e18e0d0e14 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:29.711395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 588/1170] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:29.717029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77dfc-ad10-4e05-ac86-794f961a4ae5 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:29.717422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77dfc-ad10-4e05-ac86-794f961a4ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:29.717576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77dfc-ad10-4e05-ac86-794f961a4ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:29.735941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a1e77dfc-ad10-4e05-ac86-794f961a4ae5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:29.737148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a1e77dfc-ad10-4e05-ac86-794f961a4ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:29.804784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 583/1171] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:30.072997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90311d-a2be-4d93-8522-e2e18e0d0e14 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:30.076474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:30.173042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90311d-a2be-4d93-8522-e2e18e0d0e14 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:30.205498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1672f-cc3f-4cd7-9c00-4aef62708faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:30.206113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1672f-cc3f-4cd7-9c00-4aef62708faf None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:30.206388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1672f-cc3f-4cd7-9c00-4aef62708faf None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:30.206657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1672f-cc3f-4cd7-9c00-4aef62708faf None admin] PATH_INFO: `/v3/domains/d1387a64b75a45d5a238a1d11ce4edee` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:30.217259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1672f-cc3f-4cd7-9c00-4aef62708faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1387a64b75a45d5a238a1d11ce4edee)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:30.218680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1672f-cc3f-4cd7-9c00-4aef62708faf None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:30.220283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 589/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Thu Sep 1 16:28:30 2022] GET /identity/v3/domains/d1387a64b75a45d5a238a1d11ce4edee => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:30.226022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77dfc-ad10-4e05-ac86-794f961a4ae5 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:30.285831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:30.325142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77dfc-ad10-4e05-ac86-794f961a4ae5 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:30.357629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225ad62-628b-4be4-ab7a-e874c59206d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:30.358215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ad62-628b-4be4-ab7a-e874c59206d7 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:30.358488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ad62-628b-4be4-ab7a-e874c59206d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:30.358747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225ad62-628b-4be4-ab7a-e874c59206d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:30.359873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225ad62-628b-4be4-ab7a-e874c59206d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:30.361300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225ad62-628b-4be4-ab7a-e874c59206d7 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:30.453556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 584/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:28:30 2022] POST /identity/v3/projects => generated 361 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:28:32.378016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3554-ada6-4591-bade-86dd54e28c88 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:32.378584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3554-ada6-4591-bade-86dd54e28c88 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:32.378584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3554-ada6-4591-bade-86dd54e28c88 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:32.379911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 590/1174] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:32.384897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944281de-a45f-45d1-870c-0a82de264d89 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:32.385272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944281de-a45f-45d1-870c-0a82de264d89 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:32.385448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944281de-a45f-45d1-870c-0a82de264d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:32.403295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-944281de-a45f-45d1-870c-0a82de264d89 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:32.404477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-944281de-a45f-45d1-870c-0a82de264d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:32.471437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 585/1175] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:32.736539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3554-ada6-4591-bade-86dd54e28c88 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:32.797094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:32.834517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3554-ada6-4591-bade-86dd54e28c88 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:32.867626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf2231-52f1-464b-9497-95916da8148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:32.868240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2231-52f1-464b-9497-95916da8148f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:32.868519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2231-52f1-464b-9497-95916da8148f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:32.868791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2231-52f1-464b-9497-95916da8148f None admin] PATH_INFO: `/v3/domains/d1387a64b75a45d5a238a1d11ce4edee` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:32.869898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf2231-52f1-464b-9497-95916da8148f None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1387a64b75a45d5a238a1d11ce4edee)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:32.871442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf2231-52f1-464b-9497-95916da8148f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:32.873017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 591/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Thu Sep 1 16:28:32 2022] GET /identity/v3/domains/d1387a64b75a45d5a238a1d11ce4edee => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:32.878710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944281de-a45f-45d1-870c-0a82de264d89 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:32.923528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:32.974673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944281de-a45f-45d1-870c-0a82de264d89 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:33.007710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21664b1d-a1ae-4c05-9e1f-7629af9e6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:33.008298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21664b1d-a1ae-4c05-9e1f-7629af9e6e78 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:33.008570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21664b1d-a1ae-4c05-9e1f-7629af9e6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:33.008835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21664b1d-a1ae-4c05-9e1f-7629af9e6e78 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:33.009476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21664b1d-a1ae-4c05-9e1f-7629af9e6e78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:33.010902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21664b1d-a1ae-4c05-9e1f-7629af9e6e78 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:33.120890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 586/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:28:32 2022] POST /identity/v3/users => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:28:35.058116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89e93-6421-4c26-a900-4cdb73301c81 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:35.058691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89e93-6421-4c26-a900-4cdb73301c81 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:35.058691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89e93-6421-4c26-a900-4cdb73301c81 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:35.060561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 592/1178] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:35.065796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595df68-2330-4ccc-996a-ff7dc374927e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:35.066241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595df68-2330-4ccc-996a-ff7dc374927e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:35.066348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595df68-2330-4ccc-996a-ff7dc374927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:35.084763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c595df68-2330-4ccc-996a-ff7dc374927e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:35.085972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c595df68-2330-4ccc-996a-ff7dc374927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:35.151451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 587/1179] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:35.423853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89e93-6421-4c26-a900-4cdb73301c81 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:35.523364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89e93-6421-4c26-a900-4cdb73301c81 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:35.550789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:35.556274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:35.556884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:35.557160 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:35.557430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:35.567484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:28:35.572243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:28:35.573395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:28:35.574498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 593/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:28:35.579510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595df68-2330-4ccc-996a-ff7dc374927e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:35.608921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:35.679550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595df68-2330-4ccc-996a-ff7dc374927e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:35.711703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:35.712296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:35.712572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:35.712843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:35.713502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:35.713804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:35.715189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:35.723511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 588/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:35.729289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:35.824781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f368-90b7-4946-b23f-270b07eaca13 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:35.856622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:35.857822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:35.858096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:35.858366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] PATH_INFO: `/v3/users/ab949b966ee243bb8a0030085e526ba8` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:35.870789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] RBAC: Authorizing `identity:get_user(user_id=ab949b966ee243bb8a0030085e526ba8)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:35.872244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:35.873837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 594/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:35 2022] GET /identity/v3/users/ab949b966ee243bb8a0030085e526ba8 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:35.879621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:35.968365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:35.976560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7c19c-6138-4a28-818e-3d84d9f36850 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:36.010546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:36.011148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:36.011453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:36.011724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:36.075914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:36.077343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:36.162960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:36.171893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 589/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:28:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:36.177856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:36.225972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:36.275026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5f5a-d982-480f-80cd-09d7c1c2551c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:36.307419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4052d16-39af-474b-823a-dc037d2a0ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:36.308028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052d16-39af-474b-823a-dc037d2a0ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:36.308299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052d16-39af-474b-823a-dc037d2a0ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:36.308564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052d16-39af-474b-823a-dc037d2a0ca9 None admin] PATH_INFO: `/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:36.309649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4052d16-39af-474b-823a-dc037d2a0ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=5bfe7e75523f4bc9a4bf83c530f0d2ef)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:36.311640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4052d16-39af-474b-823a-dc037d2a0ca9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:36.313231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 595/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:36 2022] GET /identity/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:36.319221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:36.414893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822cef-3ee8-4b1c-87f2-8357bf5e25e5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:36.447420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46219d1-9649-44d3-90aa-db94b837d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:36.448004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46219d1-9649-44d3-90aa-db94b837d686 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:36.448281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46219d1-9649-44d3-90aa-db94b837d686 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:36.448552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46219d1-9649-44d3-90aa-db94b837d686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:36.449264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46219d1-9649-44d3-90aa-db94b837d686 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=5bfe7e75523f4bc9a4bf83c530f0d2ef, user.id=ab949b966ee243bb8a0030085e526ba8) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:36.449571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46219d1-9649-44d3-90aa-db94b837d686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:36.452002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46219d1-9649-44d3-90aa-db94b837d686 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:36.459320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 590/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:28:36 2022] GET /identity/v3/role_assignments?user.id=ab949b966ee243bb8a0030085e526ba8&scope.project.id=5bfe7e75523f4bc9a4bf83c530f0d2ef&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:38.330669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9525d-8228-4ccc-a876-cd449f9c4be9 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.331276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9525d-8228-4ccc-a876-cd449f9c4be9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.331276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9525d-8228-4ccc-a876-cd449f9c4be9 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.332588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 596/1186] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:38.337767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947a10-2fe4-4b71-8376-03d7e5af0663 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.338189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947a10-2fe4-4b71-8376-03d7e5af0663 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.338296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947a10-2fe4-4b71-8376-03d7e5af0663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.356456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-41947a10-2fe4-4b71-8376-03d7e5af0663 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:38.358522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-41947a10-2fe4-4b71-8376-03d7e5af0663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:38.406001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:38.422170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 591/1187] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:38.693931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9525d-8228-4ccc-a876-cd449f9c4be9 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:38.798700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9525d-8228-4ccc-a876-cd449f9c4be9 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:38.814914 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:38.832036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:38.832654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.832927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.833199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.843408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:28:38.848256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:28:38.849366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:38.850412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:28:38.854335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 597/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:28:38.855542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947a10-2fe4-4b71-8376-03d7e5af0663 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:38.951718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947a10-2fe4-4b71-8376-03d7e5af0663 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:38.984060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:38.984649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.984925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.985195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.985847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:38.986147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:38.987527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:38.995230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 592/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:39.000981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:39.096752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7826c4b-2e30-497b-9996-e01fcb7a6abf None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:39.130042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:39.130660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.130950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.131269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] PATH_INFO: `/v3/users/ab949b966ee243bb8a0030085e526ba8` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.132349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] RBAC: Authorizing `identity:get_user(user_id=ab949b966ee243bb8a0030085e526ba8)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:39.133767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:39.135345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 598/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:38 2022] GET /identity/v3/users/ab949b966ee243bb8a0030085e526ba8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:39.141450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:39.193098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:39.242308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088b73c-f033-411b-9408-1e46c398f39e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:39.274577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3668c-4d2a-4ffe-8f69-1f3b6111ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:39.275216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3668c-4d2a-4ffe-8f69-1f3b6111ebbe None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.275494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3668c-4d2a-4ffe-8f69-1f3b6111ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.275765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3668c-4d2a-4ffe-8f69-1f3b6111ebbe None admin] PATH_INFO: `/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.276895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3668c-4d2a-4ffe-8f69-1f3b6111ebbe None admin] RBAC: Authorizing `identity:get_project(project_id=5bfe7e75523f4bc9a4bf83c530f0d2ef)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:39.278330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3668c-4d2a-4ffe-8f69-1f3b6111ebbe None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:39.280477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 593/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:39 2022] GET /identity/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:39.286449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:39.330924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:39.383116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f31f0b-d212-4dfa-a70e-faa0f95d14ac None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:39.416142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc820068-0487-480c-bebf-4889a676412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:39.416783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820068-0487-480c-bebf-4889a676412e None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:39.417060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820068-0487-480c-bebf-4889a676412e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:39.417330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820068-0487-480c-bebf-4889a676412e None admin] PATH_INFO: `/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef/users/ab949b966ee243bb8a0030085e526ba8/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:39.419316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc820068-0487-480c-bebf-4889a676412e None admin] RBAC: Authorizing `identity:create_grant(project_id=5bfe7e75523f4bc9a4bf83c530f0d2ef, user_id=ab949b966ee243bb8a0030085e526ba8, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:39.420744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc820068-0487-480c-bebf-4889a676412e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:39.467945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 599/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:28:39 2022] PUT /identity/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef/users/ab949b966ee243bb8a0030085e526ba8/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:28:41.363381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40afd83-eacd-42b8-9d51-7a3c5224318d None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:41.363912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40afd83-eacd-42b8-9d51-7a3c5224318d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:41.363912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40afd83-eacd-42b8-9d51-7a3c5224318d None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:41.365265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 594/1193] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:41.370222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecae92-5c06-485c-b232-a96dead38fba None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:41.370635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecae92-5c06-485c-b232-a96dead38fba None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:41.370746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecae92-5c06-485c-b232-a96dead38fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:41.389016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f9ecae92-5c06-485c-b232-a96dead38fba None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:41.390190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f9ecae92-5c06-485c-b232-a96dead38fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:41.454500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 600/1194] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:28:41.724231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40afd83-eacd-42b8-9d51-7a3c5224318d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:41.824217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40afd83-eacd-42b8-9d51-7a3c5224318d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:41.839724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:41.857446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:41.858051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:41.864593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:41.864593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:41.868331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:28:41.873078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:28:41.874201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:28:41.875140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 595/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:28:41.880236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecae92-5c06-485c-b232-a96dead38fba None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:41.913819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:41.977864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecae92-5c06-485c-b232-a96dead38fba None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:42.011094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:42.011708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:42.011988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:42.012260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:42.012941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:42.013243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:42.014597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:42.022615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 601/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:28:42.028312 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:42.123938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce340-99f1-4ad6-b4ea-18da24883ab5 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:42.157445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:42.158049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:42.158331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:42.158603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] PATH_INFO: `/v3/users/ab949b966ee243bb8a0030085e526ba8` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:42.159735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] RBAC: Authorizing `identity:get_user(user_id=ab949b966ee243bb8a0030085e526ba8)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:42.161153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:42.162695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 596/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 1 16:28:42 2022] GET /identity/v3/users/ab949b966ee243bb8a0030085e526ba8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:42.168528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:42.260515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:42.266122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bce4-cba4-4e9f-acc6-7c09c857d6f4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:42.298885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:42.299500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:42.299771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:42.300116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:42.363994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:42.365421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:42.452583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:42.458639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 602/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:28:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:42.464586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:42.509525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:42.561114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582d460-1c33-40e9-8514-9d7fdf2d4b25 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:42.593350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9951c-ca28-4aeb-87a8-6b10b7af6c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:42.593952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9951c-ca28-4aeb-87a8-6b10b7af6c96 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:42.594228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9951c-ca28-4aeb-87a8-6b10b7af6c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:42.594496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9951c-ca28-4aeb-87a8-6b10b7af6c96 None admin] PATH_INFO: `/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:42.595616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9951c-ca28-4aeb-87a8-6b10b7af6c96 None admin] RBAC: Authorizing `identity:get_project(project_id=5bfe7e75523f4bc9a4bf83c530f0d2ef)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:42.597032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9951c-ca28-4aeb-87a8-6b10b7af6c96 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:42.598631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 597/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 1 16:28:42 2022] GET /identity/v3/projects/5bfe7e75523f4bc9a4bf83c530f0d2ef => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:42.604614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:42.701065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e99d-5880-4c2e-81d1-abf2f0c436c5 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:42.733491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98817c14-2925-4473-b8fe-67e8aff396e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:42.734019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817c14-2925-4473-b8fe-67e8aff396e4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:42.734292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817c14-2925-4473-b8fe-67e8aff396e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:42.734558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817c14-2925-4473-b8fe-67e8aff396e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:42.735298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98817c14-2925-4473-b8fe-67e8aff396e4 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=5bfe7e75523f4bc9a4bf83c530f0d2ef, user.id=ab949b966ee243bb8a0030085e526ba8) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:28:42.735601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98817c14-2925-4473-b8fe-67e8aff396e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:42.737008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98817c14-2925-4473-b8fe-67e8aff396e4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:42.742548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 603/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:28:42 2022] GET /identity/v3/role_assignments?user.id=ab949b966ee243bb8a0030085e526ba8&scope.project.id=5bfe7e75523f4bc9a4bf83c530f0d2ef&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:28:52.588847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=44 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:52.740031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=70 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:56.209394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27aa80-61c1-40b0-81c6-618732eb6ae1 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:56.210002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27aa80-61c1-40b0-81c6-618732eb6ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:56.210002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27aa80-61c1-40b0-81c6-618732eb6ae1 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:56.211301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 598/1201] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:56.216484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754bcf0-4af7-4161-9ceb-55ddef5b369f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:56.216953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754bcf0-4af7-4161-9ceb-55ddef5b369f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:56.217059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754bcf0-4af7-4161-9ceb-55ddef5b369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:56.235307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e754bcf0-4af7-4161-9ceb-55ddef5b369f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:56.236585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e754bcf0-4af7-4161-9ceb-55ddef5b369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:56.304682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 604/1202] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:29:56.575266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27aa80-61c1-40b0-81c6-618732eb6ae1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:56.681896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27aa80-61c1-40b0-81c6-618732eb6ae1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:56.715840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:56.716510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:56.716780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:56.717045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:56.726845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:56.728368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:29:56.742423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:29:56.748372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:29:56.749421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:29:56.749421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:29:56.749421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:29:56.749421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 599/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:29:56.750995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754bcf0-4af7-4161-9ceb-55ddef5b369f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:56.847419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754bcf0-4af7-4161-9ceb-55ddef5b369f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:56.874884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:56.880683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9be2b3-cd8c-4f38-89e8-c8e7564265b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:56.881305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9be2b3-cd8c-4f38-89e8-c8e7564265b2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:56.881579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9be2b3-cd8c-4f38-89e8-c8e7564265b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:56.881850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9be2b3-cd8c-4f38-89e8-c8e7564265b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:56.882488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9be2b3-cd8c-4f38-89e8-c8e7564265b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:29:56.882786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9be2b3-cd8c-4f38-89e8-c8e7564265b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:56.884185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9be2b3-cd8c-4f38-89e8-c8e7564265b2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:56.896534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 605/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:29:56.902642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:56.955813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:57.001244 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd5a4f-77ef-4e13-8048-a943dda0e53a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:57.034351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff5dc8-6d85-4738-bad7-5cb97bf1d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:57.040185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff5dc8-6d85-4738-bad7-5cb97bf1d262 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:57.040185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff5dc8-6d85-4738-bad7-5cb97bf1d262 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:57.040185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff5dc8-6d85-4738-bad7-5cb97bf1d262 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:57.040185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff5dc8-6d85-4738-bad7-5cb97bf1d262 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:57.040185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff5dc8-6d85-4738-bad7-5cb97bf1d262 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:57.186330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 600/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 1 16:29:56 2022] POST /identity/v3/users => generated 251 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:29:59.125554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676aef-105a-4c9d-b16d-1c66c0d37138 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:59.126114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676aef-105a-4c9d-b16d-1c66c0d37138 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:59.126114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676aef-105a-4c9d-b16d-1c66c0d37138 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:59.127515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 606/1206] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:59.132864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aadd71-1f20-42f9-bac7-407decb66571 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:59.133321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aadd71-1f20-42f9-bac7-407decb66571 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:59.133423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aadd71-1f20-42f9-bac7-407decb66571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:59.154399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-31aadd71-1f20-42f9-bac7-407decb66571 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:59.155605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-31aadd71-1f20-42f9-bac7-407decb66571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:59.221793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 601/1207] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:29:59.514276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676aef-105a-4c9d-b16d-1c66c0d37138 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:59.638360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676aef-105a-4c9d-b16d-1c66c0d37138 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:59.674779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:59.679338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:59.679338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:59.679338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:59.688230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:29:59.693229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:29:59.694465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:29:59.695705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 607/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:29:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:29:59.700505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aadd71-1f20-42f9-bac7-407decb66571 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:59.741146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:59.802339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aadd71-1f20-42f9-bac7-407decb66571 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:59.835792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:59.836378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:59.836660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:59.836923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:59.837576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:29:59.837872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:59.839843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:59.848054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 602/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:29:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:29:59.853849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:59.913228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:59.969420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7519f-72e2-4371-9e1e-d306a599c01f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:00.006518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:00.007145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.007445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.007712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.023862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:00.025336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:00.045926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:00.046961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:00.048026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:00.048026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:00.048026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:00.048026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 608/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:00.054614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:00.160181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:00.163095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f17b8-eb66-4820-a7e9-8e7498be6276 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:00.200657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:00.201272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.201552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.201822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.202469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:00.202774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:00.204224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:00.215927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 603/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:00.221710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:00.324753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452df8f-9128-4a66-9d1b-a75fb925b67f None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:00.326277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:00.360613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:00.361247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.361524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.361795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.370971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:00.372458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:30:00.384584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:00.385784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:00.387850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 609/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:00.391824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:00.499467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607c45c-c50d-4266-9790-c2aca095bd92 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:00.539634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:00.540259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.540534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.540801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.542141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:00.542449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:00.543910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:00.561112 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 604/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 1 16:30:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:00.567051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:00.688344 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af895e5b-fc8d-4c71-878a-5ca1d9118f0c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:00.721650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:00.722264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.722533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.722799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.751289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:00.788677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:00.790120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:00.885738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 610/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:30:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:00.891680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:00.910900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:01.005202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2001-c032-41d8-a210-e019515a23f1 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:01.039350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:01.039977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:01.040254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:01.040523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:01.050959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:01.052437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:01.068329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:01.069515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:01.070700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:01.070700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:01.070700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:01.070700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 605/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:01.075309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:01.137702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:01.175352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb62e-1f5a-46c7-8554-d7acda0b293c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:01.208351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:01.208943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:01.209577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:01.209853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:01.210486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:01.210784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:01.212162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:01.223582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 611/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:01.229805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:01.303704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:01.337642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2913a6-69ed-4e90-9208-4517cfae6ebc None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:01.375710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:01.376341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:01.376618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:01.376890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:01.385800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:01.387334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:30:01.402892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:01.409676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:01.410670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 606/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:01.411234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:01.511050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2a58-9c7c-438d-a112-8589f0d07963 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:01.533524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:01.545438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc434e2-9ea9-4927-87d0-7d79eeacd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:01.546030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc434e2-9ea9-4927-87d0-7d79eeacd068 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:01.546305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc434e2-9ea9-4927-87d0-7d79eeacd068 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:01.546574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc434e2-9ea9-4927-87d0-7d79eeacd068 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:01.547294 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc434e2-9ea9-4927-87d0-7d79eeacd068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:01.547594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc434e2-9ea9-4927-87d0-7d79eeacd068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:01.549009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc434e2-9ea9-4927-87d0-7d79eeacd068 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:01.560819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 612/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:01.567036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:01.668289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf2ada-412e-4e47-9126-89e0a9c0121d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:01.695934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:01.701582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47297c12-1da1-4677-a5ea-ad0056078472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:01.702179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47297c12-1da1-4677-a5ea-ad0056078472 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:01.702458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47297c12-1da1-4677-a5ea-ad0056078472 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:01.702728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47297c12-1da1-4677-a5ea-ad0056078472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:01.703588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47297c12-1da1-4677-a5ea-ad0056078472 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=f9bc79bd5c8149679d8d7f85095e5be7) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:01.703902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47297c12-1da1-4677-a5ea-ad0056078472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:01.705329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47297c12-1da1-4677-a5ea-ad0056078472 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:01.710943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 607/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:30:01 2022] GET /identity/v3/role_assignments?user.id=f9bc79bd5c8149679d8d7f85095e5be7&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:03.787387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a457e-f78b-4a93-a351-4f5fce1ddf0d None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:03.787982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a457e-f78b-4a93-a351-4f5fce1ddf0d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:03.788282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a457e-f78b-4a93-a351-4f5fce1ddf0d None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:03.790409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 613/1220] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:03.796770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926285d-cfff-4aa4-92a9-032d886aaf5a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:03.797186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926285d-cfff-4aa4-92a9-032d886aaf5a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:03.797334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926285d-cfff-4aa4-92a9-032d886aaf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:03.815787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6926285d-cfff-4aa4-92a9-032d886aaf5a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:03.816973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6926285d-cfff-4aa4-92a9-032d886aaf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:03.885408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 608/1221] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:04.171747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a457e-f78b-4a93-a351-4f5fce1ddf0d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:04.279673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a457e-f78b-4a93-a351-4f5fce1ddf0d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:04.314210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:04.314816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:04.315093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:04.315391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:04.325863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:30:04.330692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:04.331940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:04.332798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 614/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:30:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:04.338048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926285d-cfff-4aa4-92a9-032d886aaf5a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:04.439860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926285d-cfff-4aa4-92a9-032d886aaf5a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:04.470967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:04.481905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:04.482560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:04.482841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:04.483178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:04.483845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:04.484151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:04.485522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:04.494519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 609/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:30:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:04.500479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:04.545396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:04.606881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0de9bb-296d-4012-ba4a-dead34bdce8c None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:04.645814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:04.646453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:04.646860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:04.647136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:04.659358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:04.660814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:04.678482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:04.679834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:04.680957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:04.680957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:04.680957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:04.680957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 615/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:30:04.685965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:04.797544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d6e3-c527-4b4b-8c1f-debf213f0fc6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:04.833297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:04.833885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:04.834159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:04.834444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:04.835081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:04.835410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:04.836774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:04.849474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 610/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:04.855911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:04.950506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:04.956810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550242f3-9adc-4d77-a579-94b9ab411ff7 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:04.990247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:04.990909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:04.991202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:04.991470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:04.999487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:05.000907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:30:05.012208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:05.013156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:05.014115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 616/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:05.019635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:05.068495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:05.121623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f88b-fb15-4740-8d80-5206bb53ad58 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:05.157131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:05.157718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:05.157996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:05.158265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:05.158986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:05.159346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:05.160793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:05.180677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 611/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 1 16:30:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:05.187078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:05.286028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250d21-8486-478f-bda9-4648962cfa2e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:05.323905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:05.323905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:05.323905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:05.323905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:05.332414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:05.333949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:05.349009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:05.350205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:05.351389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:05.351389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:05.351389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:05.351389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 617/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:30:05.356772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:05.456710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0d00a-204a-4a32-a5c4-8db38b286779 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:05.459088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:05.493622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:05.494264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:05.494580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:05.494849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:05.495543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:05.495901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:05.497366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:05.509224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 612/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:05.515297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:05.524961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:05.635381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3762c-134d-42a1-b395-58b8b2a7ed21 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:05.670313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:05.670954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:05.671264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:05.671539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:05.678088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:05.679577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:30:05.692339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:05.698828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:05.700637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 618/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:30:05.701244 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:05.802004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b12ad-cdbf-409a-b4bf-655a64720626 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:05.840089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae419f27-4905-440e-9b6c-f246eb852027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:05.840696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419f27-4905-440e-9b6c-f246eb852027 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:05.840974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419f27-4905-440e-9b6c-f246eb852027 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:05.841288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419f27-4905-440e-9b6c-f246eb852027 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:05.841970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae419f27-4905-440e-9b6c-f246eb852027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:05.842275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae419f27-4905-440e-9b6c-f246eb852027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:05.843737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae419f27-4905-440e-9b6c-f246eb852027 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:05.855470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 613/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:05.861695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:05.926701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:05.960246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f57db-c988-4be4-a65f-7b851a25142e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:05.993329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aef466-3222-45d3-8a86-1c5afcdb25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:05.994573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aef466-3222-45d3-8a86-1c5afcdb25ff None admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:05.994854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aef466-3222-45d3-8a86-1c5afcdb25ff None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:05.995127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aef466-3222-45d3-8a86-1c5afcdb25ff None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/f9bc79bd5c8149679d8d7f85095e5be7/roles/ab121134924143bbb0fc522f9e5a6354` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:06.009102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aef466-3222-45d3-8a86-1c5afcdb25ff None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=f9bc79bd5c8149679d8d7f85095e5be7, role_id=ab121134924143bbb0fc522f9e5a6354)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:06.010701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aef466-3222-45d3-8a86-1c5afcdb25ff None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:06.113131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 619/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:30:05 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/f9bc79bd5c8149679d8d7f85095e5be7/roles/ab121134924143bbb0fc522f9e5a6354 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:30:08.043410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b2f6-1737-4461-a04f-052f4e33f33b None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:08.043992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b2f6-1737-4461-a04f-052f4e33f33b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:08.043992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b2f6-1737-4461-a04f-052f4e33f33b None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:08.045323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 614/1233] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:08.050358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e83a8-896d-44a0-83e4-0572b7cfeef7 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:08.050797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e83a8-896d-44a0-83e4-0572b7cfeef7 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:08.050932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e83a8-896d-44a0-83e4-0572b7cfeef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:08.069114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-162e83a8-896d-44a0-83e4-0572b7cfeef7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:08.070312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-162e83a8-896d-44a0-83e4-0572b7cfeef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:08.137097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 620/1234] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:08.401327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2b2f6-1737-4461-a04f-052f4e33f33b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:08.426694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:08.501257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2b2f6-1737-4461-a04f-052f4e33f33b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:08.535009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:08.535650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:08.535927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:08.536197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:08.546984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:30:08.551795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:08.553559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:08.555435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 615/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 1 16:30:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:08.559653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e83a8-896d-44a0-83e4-0572b7cfeef7 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:08.604405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:08.656475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e83a8-896d-44a0-83e4-0572b7cfeef7 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:08.690191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:08.690785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:08.691057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:08.691353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:08.691998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:08.692292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:08.693690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:08.701220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 621/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 1 16:30:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:08.707117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:08.792892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:08.808400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c98d5f-6a00-4333-bcb7-04afd62c7a8a None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:08.840925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:08.841544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:08.841821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:08.842090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:08.852447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:08.854498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:08.868038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:08.869211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:08.870271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:08.870271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:08.870271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:08.870271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 616/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:08.875299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:08.974018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74afd3-7be1-4ce1-ac7a-b13fd4e0aa03 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:08.982516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.006943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:09.007674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.007905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.008169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.008792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:09.009132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:09.011090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:09.022776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 622/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:09.029279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:09.130180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e7ff5-a5bb-4565-b509-870d6d6357a3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:09.164128 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:09.164773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.165048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.165316 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.168047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.172785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:09.180036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:30:09.185369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:09.190510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:09.191791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 617/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:09.192713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:09.293152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adc2a-4720-4703-82c8-206f772a51ed None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:09.327619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:09.328339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.328542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.328818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.329537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:09.329841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:09.331288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:09.347909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 623/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 1 16:30:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:30:09.353874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:09.456667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e3a6c-7a25-4991-906e-9dd4185fc739 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:09.489487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:09.490085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.490363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.490637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.551247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.559526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:09.561218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:09.659962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 618/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:30:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:09.668660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:09.693784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.765799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed257c0-52b3-4a94-9ed1-e8e656456f18 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:09.801522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:09.802078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.802355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.802627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.813398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:09.814838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:09.829221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:09.830357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:09.831762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:09.831762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:09.831762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:09.831762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 624/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:09.836148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:09.928788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.934927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651244b8-31b7-4508-a7f3-208c7c561a41 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:09.967583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:09.968173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.968450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.968722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.969349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:09.969648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:09.970998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:09.982337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 619/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:09.988005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:10.066669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:10.088173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d33d-c669-4ec0-9dbe-5f82929bb4a9 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:10.121901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:10.122522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:10.122798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:10.123070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:10.129707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:10.131594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:30:10.142681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:10.151112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:10.152291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 625/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:10.152945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:10.248661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af041656-1fa8-443d-bec2-26fdd4c80b90 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:10.282872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43095d-ce73-4f11-bc24-f5de8fed06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:10.283503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43095d-ce73-4f11-bc24-f5de8fed06ae None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:10.283763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43095d-ce73-4f11-bc24-f5de8fed06ae None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:10.284033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43095d-ce73-4f11-bc24-f5de8fed06ae None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:10.284707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43095d-ce73-4f11-bc24-f5de8fed06ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:10.285006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43095d-ce73-4f11-bc24-f5de8fed06ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:10.286504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43095d-ce73-4f11-bc24-f5de8fed06ae None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:10.298808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 620/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:10.305248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:10.403768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94e99-eb82-48a6-9ea8-dffa978cb4c4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:10.437223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee4f5e-c334-43b6-8938-8c2595e4c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:10.437823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4f5e-c334-43b6-8938-8c2595e4c645 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:10.438097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4f5e-c334-43b6-8938-8c2595e4c645 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:10.438364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4f5e-c334-43b6-8938-8c2595e4c645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:10.439079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee4f5e-c334-43b6-8938-8c2595e4c645 None admin] RBAC: Adding query filter params (role.id=ab121134924143bbb0fc522f9e5a6354, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=f9bc79bd5c8149679d8d7f85095e5be7) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:10.439412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee4f5e-c334-43b6-8938-8c2595e4c645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:10.440834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee4f5e-c334-43b6-8938-8c2595e4c645 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:10.447454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 626/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:30:10 2022] GET /identity/v3/role_assignments?user.id=f9bc79bd5c8149679d8d7f85095e5be7&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=ab121134924143bbb0fc522f9e5a6354 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:12.417628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046eeeb-6c03-4a87-b5b3-73da8189ad3d None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:12.418196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046eeeb-6c03-4a87-b5b3-73da8189ad3d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:12.418196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046eeeb-6c03-4a87-b5b3-73da8189ad3d None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:12.419546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 621/1247] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:12.424779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f4a12-f1a8-4af2-aa2a-0d489ad84dc8 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:12.425169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f4a12-f1a8-4af2-aa2a-0d489ad84dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:12.425312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f4a12-f1a8-4af2-aa2a-0d489ad84dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:12.432292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:12.444563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-880f4a12-f1a8-4af2-aa2a-0d489ad84dc8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:12.447478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-880f4a12-f1a8-4af2-aa2a-0d489ad84dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:12.512118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 627/1248] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:12.781657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046eeeb-6c03-4a87-b5b3-73da8189ad3d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:12.802093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:12.884416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046eeeb-6c03-4a87-b5b3-73da8189ad3d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:12.918025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:12.918632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:12.918936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:12.919230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:12.929023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:30:12.934296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:12.935473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:12.936559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 622/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:12.941499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f4a12-f1a8-4af2-aa2a-0d489ad84dc8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:13.038024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f4a12-f1a8-4af2-aa2a-0d489ad84dc8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:13.067233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:13.072254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:13.072844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:13.073118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:13.073384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:13.074141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:13.074438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:13.075823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:13.083663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 628/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:30:13.089916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:13.166064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:13.188264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d686-4073-4a05-81cd-e14b76763724 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:13.220866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:13.221520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:13.221825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:13.222100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:13.232816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:13.234328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:13.248031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:13.254912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:13.256068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:13.256068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:13.256068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:13.256068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 623/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:13.256296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:13.352720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872598d9-9364-4d69-a492-9ae1fcbbacf4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:13.385628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:13.386222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:13.386501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:13.386790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:13.387444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:13.387749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:13.389155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:13.401497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 629/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:13.407382 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:13.505329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d43018-ea95-4856-842f-216742a0ed0c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:13.531419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:13.538843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:13.539492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:13.539769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:13.540039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:13.547226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:13.548656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:30:13.559401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:13.560626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:13.561880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 624/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:13.566410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:13.622299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:13.666501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc7b0e-0db6-40a3-bfc7-49f9b4f4a998 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:13.699680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:13.700273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:13.700550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:13.700820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:13.701536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:13.701836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:13.703299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:13.720801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 630/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 1 16:30:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:13.726638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:13.828162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c0b2-d9ea-4705-a5f0-4762a7c1558e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:13.861096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:13.861689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:13.861970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:13.862237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:13.916669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:13.928589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:13.930041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:14.027518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 625/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:30:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:14.033343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:14.132128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d11988-9699-4bf7-8a7a-417d857031e0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:14.145107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:14.166381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:14.167042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:14.167303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:14.167569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:14.177463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:14.178879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:14.193041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:14.194173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:14.195130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:14.195130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:14.195130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:14.195130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 631/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:14.200420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:14.285904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:14.297267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96866-5ed0-4650-be15-91e223b8fe7c None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:14.329792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:14.330382 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:14.330655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:14.330919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:14.331581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:14.331877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:14.333276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:14.344624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 626/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:14.355879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:14.448565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533443d3-5cce-4171-b5d3-b5b0489964ea None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:14.482291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:14.482915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:14.483212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:14.483483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:14.490079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:14.491533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:30:14.503139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:14.504212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:14.505404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 632/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:14.510199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:14.609989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687c4f-0548-406d-82cc-90a691bbfea9 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:14.646557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7678c-b4ba-4401-ab15-149bec74d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:14.647197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7678c-b4ba-4401-ab15-149bec74d277 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:14.647475 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7678c-b4ba-4401-ab15-149bec74d277 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:14.647764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7678c-b4ba-4401-ab15-149bec74d277 None admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:14.650375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7678c-b4ba-4401-ab15-149bec74d277 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:14.650375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7678c-b4ba-4401-ab15-149bec74d277 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:14.651095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7678c-b4ba-4401-ab15-149bec74d277 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:14.662948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 627/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:14.669641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:14.694954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:14.766830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fddf5-c6cb-46c1-820e-76d3064be94b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:14.800175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac0b4e-c41f-4d00-a2ac-6c3f28ef9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:14.800765 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0b4e-c41f-4d00-a2ac-6c3f28ef9751 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:14.801038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0b4e-c41f-4d00-a2ac-6c3f28ef9751 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:14.801306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac0b4e-c41f-4d00-a2ac-6c3f28ef9751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:14.802015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac0b4e-c41f-4d00-a2ac-6c3f28ef9751 None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=f9bc79bd5c8149679d8d7f85095e5be7) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:14.802318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac0b4e-c41f-4d00-a2ac-6c3f28ef9751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:14.803761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac0b4e-c41f-4d00-a2ac-6c3f28ef9751 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:14.808974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 633/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:30:14 2022] GET /identity/v3/role_assignments?user.id=f9bc79bd5c8149679d8d7f85095e5be7&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:16.673217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311357-9791-4a4b-ba45-374dccc3e051 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:16.673718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311357-9791-4a4b-ba45-374dccc3e051 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:16.673718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311357-9791-4a4b-ba45-374dccc3e051 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:16.675076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 628/1261] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:16.680139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6518b-e47e-4300-9745-914ad041395f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:16.680567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6518b-e47e-4300-9745-914ad041395f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:16.680690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6518b-e47e-4300-9745-914ad041395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:16.699168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f1d6518b-e47e-4300-9745-914ad041395f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:16.700361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f1d6518b-e47e-4300-9745-914ad041395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:16.766534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 634/1262] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:17.044219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a311357-9791-4a4b-ba45-374dccc3e051 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:17.054970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:17.145523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a311357-9791-4a4b-ba45-374dccc3e051 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:17.180277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:17.181470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:17.181752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:17.182025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:17.192680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:30:17.197526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:17.198505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:17.199463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 629/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:17.206174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6518b-e47e-4300-9745-914ad041395f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:17.224921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:17.307231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6518b-e47e-4300-9745-914ad041395f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:17.344498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:17.345117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:17.345405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:17.345670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:17.346342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:17.346644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:17.348083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:17.356949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 635/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:17.362734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:17.429325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:17.461603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256ee6-8fd3-4863-8037-3f3a5f9aa4f7 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:17.494385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:17.494998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:17.495305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:17.495573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:17.506217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:17.508125 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:17.522687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:17.523711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:17.524655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:17.524655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:17.524655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:17.529104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 630/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:17.529947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:17.613867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:17.632422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d26f-08de-4c7a-9854-313a687e50bb None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:17.668515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:17.669122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:17.669391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:17.669660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:17.670296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:17.670589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:17.672051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:17.686182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 636/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:30:17.692249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:17.795844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d65456-9725-483e-8a0d-8ad5f4ab1689 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:17.815327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:17.828896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:17.829512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:17.829801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:17.830087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:17.837781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:17.839422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:30:17.850345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:17.851524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:17.852554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 631/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:17.858089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:17.956409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b955e1b-1c66-4a65-b1e0-087a04525e9e None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:17.989213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:17.989809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:17.990087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:17.990359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:17.991083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:17.991417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:17.992850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:18.001342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:18.010324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 637/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 1 16:30:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:18.016345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:18.115647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc4a65-c90b-4656-86f1-dce1f02e4e61 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:18.149219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:18.158819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.158819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.158819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.162271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:18.163784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:18.177647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:18.178645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:18.179716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:18.179716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:18.179716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:18.179716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 632/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:18.184907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:18.284496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312213e-0e39-4b4a-a5b4-37d1be085f90 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:18.324973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:18.325577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.325849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.326117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.326755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:18.327056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:18.328435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:18.340839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 638/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:18.346683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:18.380314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:18.451363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6a8b6-24e9-4de7-acc3-042bd0fff95d None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:18.487630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:18.488293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.488574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.488851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.495731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:18.497181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:30:18.513777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:18.514782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:18.515760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 633/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:18.521612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:18.584009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:18.626566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4e59d-f254-4c2b-8674-c006cfc12474 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:18.663954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ef050-fa21-44f6-8af2-40b2c011d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:18.664512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef050-fa21-44f6-8af2-40b2c011d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.664789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef050-fa21-44f6-8af2-40b2c011d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.665084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ef050-fa21-44f6-8af2-40b2c011d2a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.666364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ef050-fa21-44f6-8af2-40b2c011d2a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:18.666666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ef050-fa21-44f6-8af2-40b2c011d2a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:18.668118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ef050-fa21-44f6-8af2-40b2c011d2a8 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:18.680135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 639/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:30:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:18.686368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:18.777266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:18.785740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6ec4-3ae8-40a9-b68d-28540e07552f None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:18.818031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f7d8e-2213-45fb-986f-35516bf75159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:18.818675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f7d8e-2213-45fb-986f-35516bf75159 None admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.818951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f7d8e-2213-45fb-986f-35516bf75159 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.819250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f7d8e-2213-45fb-986f-35516bf75159 None admin] PATH_INFO: `/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/f9bc79bd5c8149679d8d7f85095e5be7/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.821123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f7d8e-2213-45fb-986f-35516bf75159 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49e0bb6358e44ef93862d3cf244efc4, user_id=f9bc79bd5c8149679d8d7f85095e5be7, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:18.823072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f7d8e-2213-45fb-986f-35516bf75159 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:18.905682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 634/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 1 16:30:18 2022] PUT /identity/v3/projects/f49e0bb6358e44ef93862d3cf244efc4/users/f9bc79bd5c8149679d8d7f85095e5be7/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:30:20.816996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd84d-fe10-495a-8a61-de909db0a1e3 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:20.817512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd84d-fe10-495a-8a61-de909db0a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:20.817606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd84d-fe10-495a-8a61-de909db0a1e3 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:20.818881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 640/1274] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:20.823966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44409a1f-2f0d-4568-9f6a-a71221fbe675 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:20.824349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44409a1f-2f0d-4568-9f6a-a71221fbe675 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:20.824503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44409a1f-2f0d-4568-9f6a-a71221fbe675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:20.842705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-44409a1f-2f0d-4568-9f6a-a71221fbe675 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:20.843902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-44409a1f-2f0d-4568-9f6a-a71221fbe675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:20.914661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 635/1275] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:21.184417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd84d-fe10-495a-8a61-de909db0a1e3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:21.287667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd84d-fe10-495a-8a61-de909db0a1e3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:21.304485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:21.321260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:21.322440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.322716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.322982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:21.332992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:30:21.337980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:21.338909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:21.340042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 641/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 1 16:30:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:21.345183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44409a1f-2f0d-4568-9f6a-a71221fbe675 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:21.424565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:21.442653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44409a1f-2f0d-4568-9f6a-a71221fbe675 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:21.476628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:21.477224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.477522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.477818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:21.478502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:21.478808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:21.480208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:21.488065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 636/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 1 16:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:21.494420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:21.599481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c3cb-7bbf-42b8-b74e-974bb8f9a1ef None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:21.633582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:21.634792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.635092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.635472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:21.647579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:21.649155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:21.664408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:21.666091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:21.667097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:21.667097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:21.667097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:21.667097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 642/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:21.672166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:21.773179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f496a6-3672-43c0-9079-c0c719d502a3 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:21.806709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:21.807322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.807594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.807857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:21.808482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:21.808776 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:21.810150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:21.822098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 637/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:21.827884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:21.858894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:21.928482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38191678-e928-4dcc-b20b-1fdb86d11f0b None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:21.962107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:21.962729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:21.963008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:21.963328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:21.970948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:21.972473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:30:21.984099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:21.985255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:21.986396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 643/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:21.991078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:21.995645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:22.093643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ec204-a3a5-4649-96b2-a7860b97ea2e None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:22.128687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:22.129275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.129546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.129813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.130574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:22.130912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:22.132376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:22.151014 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 638/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 1 16:30:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:22.156904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:22.252335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:22.261835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc86748-92e4-4272-a908-0c1df20ffdac None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:22.297438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:22.298057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.298347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.298649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.365472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:22.366884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:22.465778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:22.474124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 644/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 1 16:30:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:22.480425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:22.544869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:22.582691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f6d27-20c6-4a7d-8c33-e4c8521bb3d6 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:22.616418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:22.616977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.617247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.617510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.627069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:22.628547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:30:22.643008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:22.644294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:30:22.645434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:30:22.645434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:30:22.645434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:22.645434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 639/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:22.650945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:22.752074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c7804-a152-43f0-b7ac-bbdf538945b2 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:22.786769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:22.787403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.787681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.787952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.788753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:22.789060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:22.790457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:22.801814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 645/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:30:22.808077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:22.908164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93722e70-b655-488a-8d58-e7bf5609e4f0 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:22.923623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:22.945180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:22.945805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:22.946865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:22.947138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:22.954119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:22.955746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:30:22.967487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:22.968609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: ERROR keystone.server.flask.application Sep 01 16:30:22.969726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 640/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 1 16:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:22.974483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:23.025500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:23.074413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd9e39-779d-4d80-8859-d58bfa016bc0 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:23.107801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fc1ec-37bd-4247-b8eb-cccada1ee333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:23.108393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc1ec-37bd-4247-b8eb-cccada1ee333 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:23.108689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc1ec-37bd-4247-b8eb-cccada1ee333 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:23.108973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc1ec-37bd-4247-b8eb-cccada1ee333 None admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:23.109656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc1ec-37bd-4247-b8eb-cccada1ee333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:23.109957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc1ec-37bd-4247-b8eb-cccada1ee333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:23.111444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc1ec-37bd-4247-b8eb-cccada1ee333 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:23.123698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 646/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 1 16:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:30:23.130012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:23.237807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed1d83-c443-4adb-adec-d43cbcd16600 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:23.272991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c979-7f6c-4af4-931d-64759912581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:23.273672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c979-7f6c-4af4-931d-64759912581c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:23.273951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c979-7f6c-4af4-931d-64759912581c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:23.274241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c979-7f6c-4af4-931d-64759912581c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:23.274961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c979-7f6c-4af4-931d-64759912581c None admin] RBAC: Adding query filter params (role.id=30b5862c5d6a491b8aa1bb162c62bf6a, scope.project.id=f49e0bb6358e44ef93862d3cf244efc4, user.id=f9bc79bd5c8149679d8d7f85095e5be7) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:23.275302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c979-7f6c-4af4-931d-64759912581c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:23.276740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c979-7f6c-4af4-931d-64759912581c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:23.282463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 641/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 1 16:30:23 2022] GET /identity/v3/role_assignments?user.id=f9bc79bd5c8149679d8d7f85095e5be7&scope.project.id=f49e0bb6358e44ef93862d3cf244efc4&role.id=30b5862c5d6a491b8aa1bb162c62bf6a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:25.225409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da173073-4252-419c-8afd-e2d360b889ec None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:25.225941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da173073-4252-419c-8afd-e2d360b889ec None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:25.225941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da173073-4252-419c-8afd-e2d360b889ec None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:25.227868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 647/1288] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:30:25.233039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb7c58-2af1-4fa8-8156-7ec206b4cd80 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:25.233437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb7c58-2af1-4fa8-8156-7ec206b4cd80 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:25.233587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb7c58-2af1-4fa8-8156-7ec206b4cd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:25.251381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2ffb7c58-2af1-4fa8-8156-7ec206b4cd80 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:25.252557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2ffb7c58-2af1-4fa8-8156-7ec206b4cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:25.281935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:25.318333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 642/1289] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:25.597254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da173073-4252-419c-8afd-e2d360b889ec None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:25.705351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da173073-4252-419c-8afd-e2d360b889ec None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:25.718447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:25.740936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:25.741553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:25.741828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:25.742095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:25.742664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:25.744100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:25.752632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:25.754030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:25.755124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 648/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:30:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:25.760539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb7c58-2af1-4fa8-8156-7ec206b4cd80 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:25.864152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb7c58-2af1-4fa8-8156-7ec206b4cd80 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:25.901531 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4c202-a532-46cf-8791-eb7be2af624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:25.902165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c202-a532-46cf-8791-eb7be2af624c None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:25.902483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c202-a532-46cf-8791-eb7be2af624c None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:25.902748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c202-a532-46cf-8791-eb7be2af624c None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:25.903454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4c202-a532-46cf-8791-eb7be2af624c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:25.903759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4c202-a532-46cf-8791-eb7be2af624c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:25.905129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4c202-a532-46cf-8791-eb7be2af624c None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:25.911136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 643/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 1 16:30:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:25.918889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:26.021631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce8bb2-f338-400b-b75d-cce379c4b113 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:26.056003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bbf8e-a2d6-4173-bef8-ee2b739ea9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:26.056622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbf8e-a2d6-4173-bef8-ee2b739ea9fd None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:26.056899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbf8e-a2d6-4173-bef8-ee2b739ea9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:26.057181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbf8e-a2d6-4173-bef8-ee2b739ea9fd None admin] PATH_INFO: `/v3/services` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:26.057820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bbf8e-a2d6-4173-bef8-ee2b739ea9fd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:26.058117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bbf8e-a2d6-4173-bef8-ee2b739ea9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:26.059588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bbf8e-a2d6-4173-bef8-ee2b739ea9fd None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:26.064031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 649/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 1 16:30:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:27.994565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c19ea-3229-439f-b02d-ec3bf7b9d533 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:27.995079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c19ea-3229-439f-b02d-ec3bf7b9d533 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:27.995079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c19ea-3229-439f-b02d-ec3bf7b9d533 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:27.996389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 644/1293] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:28.001488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604bd9-3b38-49ce-811b-24eba2575c18 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:28.001983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604bd9-3b38-49ce-811b-24eba2575c18 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:28.002157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604bd9-3b38-49ce-811b-24eba2575c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:28.021371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c3604bd9-3b38-49ce-811b-24eba2575c18 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:28.022551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c3604bd9-3b38-49ce-811b-24eba2575c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:28.052037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:28.088730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 650/1294] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:28.359276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c19ea-3229-439f-b02d-ec3bf7b9d533 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:28.391142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:28.458993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c19ea-3229-439f-b02d-ec3bf7b9d533 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:28.491893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd9176-3c3f-4390-a3d2-48ad3fe5a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:28.492531 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9176-3c3f-4390-a3d2-48ad3fe5a121 None admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:28.493415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9176-3c3f-4390-a3d2-48ad3fe5a121 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:28.497938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9176-3c3f-4390-a3d2-48ad3fe5a121 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:28.497938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd9176-3c3f-4390-a3d2-48ad3fe5a121 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:28.497938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd9176-3c3f-4390-a3d2-48ad3fe5a121 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:28.613993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 645/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 1 16:30:28 2022] POST /identity/v3/services => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:30:30.536161 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bd8e-03ff-43d4-a5f4-747ebd901d3d None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:30.536681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bd8e-03ff-43d4-a5f4-747ebd901d3d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:30.536681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bd8e-03ff-43d4-a5f4-747ebd901d3d None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:30.538095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 651/1296] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:30.543485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bea51-cb0d-4a35-ad5c-6d50daf334bc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:30.543945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bea51-cb0d-4a35-ad5c-6d50daf334bc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:30.544027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bea51-cb0d-4a35-ad5c-6d50daf334bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:30.562797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-443bea51-cb0d-4a35-ad5c-6d50daf334bc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:30.564108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-443bea51-cb0d-4a35-ad5c-6d50daf334bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:30.641704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 646/1297] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:30:30.907040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bd8e-03ff-43d4-a5f4-747ebd901d3d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:31.006613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bd8e-03ff-43d4-a5f4-747ebd901d3d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:31.041041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:31.041697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:31.041971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:31.042236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:31.042925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:31.044373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:31.053150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:31.054321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:31.055989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 652/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:30:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:31.060953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bea51-cb0d-4a35-ad5c-6d50daf334bc None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:31.079320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:31.159050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bea51-cb0d-4a35-ad5c-6d50daf334bc None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:31.192623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:31.193330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:31.193539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:31.193828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:31.194425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:31.194721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:31.196137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:31.201001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 647/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 1 16:30:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:31.206978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:31.239002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:31.305732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6fb39-feb5-4fee-b5b3-70719ae6cb22 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:31.338559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c649c-3bc7-4efa-8cbb-70fb30c10694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:31.339240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c649c-3bc7-4efa-8cbb-70fb30c10694 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:31.339517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c649c-3bc7-4efa-8cbb-70fb30c10694 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:31.339782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c649c-3bc7-4efa-8cbb-70fb30c10694 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:31.340473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c649c-3bc7-4efa-8cbb-70fb30c10694 None admin] RBAC: Adding query filter params (interface=public, service_id=44d6348556644bd0b8a132a41715d24a, region_id=RegionOne) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:31.340773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c649c-3bc7-4efa-8cbb-70fb30c10694 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:31.342241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c649c-3bc7-4efa-8cbb-70fb30c10694 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:31.347238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 653/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 1 16:30:31 2022] GET /identity/v3/endpoints?service_id=44d6348556644bd0b8a132a41715d24a&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:31.353559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:31.433951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:31.452196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e473568-6020-475d-928c-5d41ceeb0359 None admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:31.485107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ef51f-8af3-4c79-911a-bd636a23a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:31.485696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef51f-8af3-4c79-911a-bd636a23a137 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:31.485972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef51f-8af3-4c79-911a-bd636a23a137 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:31.486244 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef51f-8af3-4c79-911a-bd636a23a137 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:31.486840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ef51f-8af3-4c79-911a-bd636a23a137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:31.488254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ef51f-8af3-4c79-911a-bd636a23a137 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:31.494812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 648/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 1 16:30:31 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:30:33.421830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12941b8-bb57-4501-b70d-39ff50055119 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:33.422384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12941b8-bb57-4501-b70d-39ff50055119 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:33.422384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12941b8-bb57-4501-b70d-39ff50055119 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:33.423800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 654/1302] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:33.428970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8406-2594-43ec-a331-2cbbb1342b7c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:33.429346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8406-2594-43ec-a331-2cbbb1342b7c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:33.429504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f8406-2594-43ec-a331-2cbbb1342b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:33.448421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d80f8406-2594-43ec-a331-2cbbb1342b7c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:33.449585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d80f8406-2594-43ec-a331-2cbbb1342b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:33.515529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 649/1303] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:30:33.789078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12941b8-bb57-4501-b70d-39ff50055119 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:33.884378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:33.891100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12941b8-bb57-4501-b70d-39ff50055119 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:33.924990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:33.925613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:33.925889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:33.926155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:33.926724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:33.928109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:30:33.937468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:30:33.938725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application with Lock( Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: ERROR keystone.server.flask.application Sep 01 16:30:33.939808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 655/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 1 16:30:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:30:33.944599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8406-2594-43ec-a331-2cbbb1342b7c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:34.018903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:34.040936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f8406-2594-43ec-a331-2cbbb1342b7c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:34.075748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748977e-f5a2-4374-a172-85ce5a5b8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:34.076351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748977e-f5a2-4374-a172-85ce5a5b8f37 None admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:34.076963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748977e-f5a2-4374-a172-85ce5a5b8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:34.076963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748977e-f5a2-4374-a172-85ce5a5b8f37 None admin] PATH_INFO: `/v3/services` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:34.077494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748977e-f5a2-4374-a172-85ce5a5b8f37 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:34.077790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748977e-f5a2-4374-a172-85ce5a5b8f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:34.079175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748977e-f5a2-4374-a172-85ce5a5b8f37 None admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:34.084267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 650/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 1 16:30:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:30:34.091092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:34.190058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13d1f-28fe-4038-81de-0f9a05d35eb4 None admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:34.222417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26077-c753-4336-affb-a0b6b6900096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:34.223365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26077-c753-4336-affb-a0b6b6900096 None admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:34.223648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26077-c753-4336-affb-a0b6b6900096 None admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:34.223926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26077-c753-4336-affb-a0b6b6900096 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:34.224591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26077-c753-4336-affb-a0b6b6900096 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:34.225956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26077-c753-4336-affb-a0b6b6900096 None admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:34.354138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 656/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:30:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:30:44.103623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=30 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:44.346433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:26.952545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758b0a-9984-44af-8ee6-d764b70a18ff None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:26.953514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758b0a-9984-44af-8ee6-d764b70a18ff None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:26.954658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758b0a-9984-44af-8ee6-d764b70a18ff None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:26.961585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baf26f-ddc9-4cb2-8986-46d8c1cc8f40 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:26.962565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baf26f-ddc9-4cb2-8986-46d8c1cc8f40 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:26.962960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baf26f-ddc9-4cb2-8986-46d8c1cc8f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:26.966078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 651/1307] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:27.071818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-78baf26f-ddc9-4cb2-8986-46d8c1cc8f40 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:27.073333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-78baf26f-ddc9-4cb2-8986-46d8c1cc8f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:27.223326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 657/1308] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:38:27.517634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bde03-10d0-466c-81cb-afa41d428a1a None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:27.517964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bde03-10d0-466c-81cb-afa41d428a1a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:27.518175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bde03-10d0-466c-81cb-afa41d428a1a None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:27.519541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 652/1309] 10.222.0.69 () {54 vars in 965 bytes} [Thu Sep 1 16:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:27.525691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d821397-7cb8-4f10-9d1a-10950aa8d6a2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:27.525983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d821397-7cb8-4f10-9d1a-10950aa8d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:27.526262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d821397-7cb8-4f10-9d1a-10950aa8d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:27.608940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9d821397-7cb8-4f10-9d1a-10950aa8d6a2 None None] MFA Rules not processed for user `94c7e57c93dd49a1a3e784002ae94fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:27.611188 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9d821397-7cb8-4f10-9d1a-10950aa8d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:27.632456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:27.711407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bde03-10d0-466c-81cb-afa41d428a1a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:27.713589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-282bde03-10d0-466c-81cb-afa41d428a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:27.718194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 658/1310] 10.222.0.69 () {58 vars in 1062 bytes} [Thu Sep 1 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:27.844303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bde03-10d0-466c-81cb-afa41d428a1a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:27.935987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1854b-29a6-4720-abf1-b13b64a11af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:27.936712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1854b-29a6-4720-abf1-b13b64a11af0 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:27.936989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1854b-29a6-4720-abf1-b13b64a11af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:27.937255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1854b-29a6-4720-abf1-b13b64a11af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:27.939628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b8c1854b-29a6-4720-abf1-b13b64a11af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:28.007403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:28.070618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1854b-29a6-4720-abf1-b13b64a11af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:28.072724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1854b-29a6-4720-abf1-b13b64a11af0 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:28.094300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 653/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:38:30.383773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50efce-f702-462d-83f7-6667273091c2 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:30.384332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50efce-f702-462d-83f7-6667273091c2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:30.384332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50efce-f702-462d-83f7-6667273091c2 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:30.385972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 659/1312] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:30.392304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51b434-b6ce-47f1-ac1c-43276dc9203c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:30.392840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51b434-b6ce-47f1-ac1c-43276dc9203c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:30.392840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51b434-b6ce-47f1-ac1c-43276dc9203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:30.465888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ae51b434-b6ce-47f1-ac1c-43276dc9203c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:30.467097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ae51b434-b6ce-47f1-ac1c-43276dc9203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:30.566729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 654/1313] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:30.850056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50efce-f702-462d-83f7-6667273091c2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:30.851631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7e50efce-f702-462d-83f7-6667273091c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:30.954855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50efce-f702-462d-83f7-6667273091c2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:31.026037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:31.028577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11d2ac-a804-40f0-98b7-96cf880ed75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:31.029177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d2ac-a804-40f0-98b7-96cf880ed75d service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:31.029453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d2ac-a804-40f0-98b7-96cf880ed75d service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:31.029719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d2ac-a804-40f0-98b7-96cf880ed75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:31.031343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2d11d2ac-a804-40f0-98b7-96cf880ed75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:31.139754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11d2ac-a804-40f0-98b7-96cf880ed75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:31.141217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11d2ac-a804-40f0-98b7-96cf880ed75d service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:31.158657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 660/1314] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:33.590201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29381ffc-da73-4a7c-b87a-1b5c664a95a1 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:33.590733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29381ffc-da73-4a7c-b87a-1b5c664a95a1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:33.590733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29381ffc-da73-4a7c-b87a-1b5c664a95a1 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:33.592122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 655/1315] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:33.597688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423848c-4aa3-4826-a9a3-b1912b155dc0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:33.598129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423848c-4aa3-4826-a9a3-b1912b155dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:33.598246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423848c-4aa3-4826-a9a3-b1912b155dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:33.664307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1423848c-4aa3-4826-a9a3-b1912b155dc0 None None] MFA Rules not processed for user `b5b2b954da284ecb87a3f54d5505374e`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:33.665518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1423848c-4aa3-4826-a9a3-b1912b155dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:33.715465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:33.758589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 661/1316] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:34.045593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29381ffc-da73-4a7c-b87a-1b5c664a95a1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:34.047222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-29381ffc-da73-4a7c-b87a-1b5c664a95a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:34.057029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:34.151034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29381ffc-da73-4a7c-b87a-1b5c664a95a1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:34.224014 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108a09-8751-4bb3-8de1-c86ff0d7d818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:34.224574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108a09-8751-4bb3-8de1-c86ff0d7d818 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:34.224851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108a09-8751-4bb3-8de1-c86ff0d7d818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:34.225164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108a09-8751-4bb3-8de1-c86ff0d7d818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:34.226735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f9108a09-8751-4bb3-8de1-c86ff0d7d818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:34.287263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:34.333224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108a09-8751-4bb3-8de1-c86ff0d7d818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:34.334659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108a09-8751-4bb3-8de1-c86ff0d7d818 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:34.352050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 656/1317] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:37.033915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a730f-2c6f-4a57-8664-2e067e53a187 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:37.034512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a730f-2c6f-4a57-8664-2e067e53a187 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:37.034512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a730f-2c6f-4a57-8664-2e067e53a187 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:37.035899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 662/1318] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:37.040873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b77ac-3239-4430-85ad-14ebcc832022 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:37.044994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b77ac-3239-4430-85ad-14ebcc832022 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:37.044994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b77ac-3239-4430-85ad-14ebcc832022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:37.106730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-454b77ac-3239-4430-85ad-14ebcc832022 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:37.107955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-454b77ac-3239-4430-85ad-14ebcc832022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:37.204399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 657/1319] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:37.490385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a730f-2c6f-4a57-8664-2e067e53a187 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:37.491963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-122a730f-2c6f-4a57-8664-2e067e53a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:37.594914 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a730f-2c6f-4a57-8664-2e067e53a187 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:37.669011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51c414-3363-4ceb-88cd-57127e25f81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:37.669614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c414-3363-4ceb-88cd-57127e25f81c service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:37.669888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c414-3363-4ceb-88cd-57127e25f81c service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:37.670152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c414-3363-4ceb-88cd-57127e25f81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:37.671759 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9e51c414-3363-4ceb-88cd-57127e25f81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:37.679118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:37.778603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51c414-3363-4ceb-88cd-57127e25f81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:37.780064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51c414-3363-4ceb-88cd-57127e25f81c service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:37.798547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 663/1320] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:41.046240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365cf9-3636-4927-80c4-72bc7a0463d2 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.046799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365cf9-3636-4927-80c4-72bc7a0463d2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.046799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365cf9-3636-4927-80c4-72bc7a0463d2 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.048731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 658/1321] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:41.053961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f4fef-d6e9-4127-9ee6-0fd676ea47d6 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.054353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f4fef-d6e9-4127-9ee6-0fd676ea47d6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.054676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f4fef-d6e9-4127-9ee6-0fd676ea47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.121231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4a2f4fef-d6e9-4127-9ee6-0fd676ea47d6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:41.122484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4a2f4fef-d6e9-4127-9ee6-0fd676ea47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.181631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:41.224635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 664/1322] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:41.506457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365cf9-3636-4927-80c4-72bc7a0463d2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:41.508053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d3365cf9-3636-4927-80c4-72bc7a0463d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.527909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:41.614023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365cf9-3636-4927-80c4-72bc7a0463d2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:41.688759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43e8d5-4a50-4590-b2d7-4486e2c26a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:41.689356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43e8d5-4a50-4590-b2d7-4486e2c26a87 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.689630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43e8d5-4a50-4590-b2d7-4486e2c26a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.689895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43e8d5-4a50-4590-b2d7-4486e2c26a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.691496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9b43e8d5-4a50-4590-b2d7-4486e2c26a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.761528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:41.797799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43e8d5-4a50-4590-b2d7-4486e2c26a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:41.799832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43e8d5-4a50-4590-b2d7-4486e2c26a87 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:41.818498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 659/1323] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:43.773387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b474-de7b-45f5-b288-85ce82d5c32d None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:43.774280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b474-de7b-45f5-b288-85ce82d5c32d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:43.774559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b474-de7b-45f5-b288-85ce82d5c32d None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:43.775974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 665/1324] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:43.781879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae62546-99b7-4491-9d1e-dd3b49d34a9d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:43.782311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae62546-99b7-4491-9d1e-dd3b49d34a9d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:43.782482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae62546-99b7-4491-9d1e-dd3b49d34a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:43.850660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-7ae62546-99b7-4491-9d1e-dd3b49d34a9d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:43.851887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7ae62546-99b7-4491-9d1e-dd3b49d34a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:43.949010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 660/1325] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:44.237440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9b474-de7b-45f5-b288-85ce82d5c32d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:44.239081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bbe9b474-de7b-45f5-b288-85ce82d5c32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:44.354037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9b474-de7b-45f5-b288-85ce82d5c32d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:44.427968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b4d34-3ce2-46b6-9f2d-5d1c9757e525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:44.428613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b4d34-3ce2-46b6-9f2d-5d1c9757e525 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:44.428894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b4d34-3ce2-46b6-9f2d-5d1c9757e525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:44.429164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b4d34-3ce2-46b6-9f2d-5d1c9757e525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:44.430764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-673b4d34-3ce2-46b6-9f2d-5d1c9757e525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:44.449212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:44.545034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b4d34-3ce2-46b6-9f2d-5d1c9757e525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:44.546485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b4d34-3ce2-46b6-9f2d-5d1c9757e525 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:44.568757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 666/1326] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:46.550006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f122a-7aea-43da-8b33-10c12ad5cd00 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.550562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f122a-7aea-43da-8b33-10c12ad5cd00 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.550669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f122a-7aea-43da-8b33-10c12ad5cd00 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.552141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 661/1327] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:46.557763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33bd16-cf7a-421f-bfda-1e9cede0810b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.558156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33bd16-cf7a-421f-bfda-1e9cede0810b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.558422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33bd16-cf7a-421f-bfda-1e9cede0810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.628647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1f33bd16-cf7a-421f-bfda-1e9cede0810b None None] MFA Rules not processed for user `b5b2b954da284ecb87a3f54d5505374e`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:46.630126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1f33bd16-cf7a-421f-bfda-1e9cede0810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:46.697927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:46.729729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 667/1328] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:47.039216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df378d-5031-47e7-933b-ee5d9d88905d None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.039637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df378d-5031-47e7-933b-ee5d9d88905d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.039914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df378d-5031-47e7-933b-ee5d9d88905d None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.041290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 662/1329] 10.222.0.69 () {54 vars in 965 bytes} [Thu Sep 1 16:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:47.047063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83715-71e2-49f6-80c1-e4ed8dabbed0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.047376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83715-71e2-49f6-80c1-e4ed8dabbed0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.047652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83715-71e2-49f6-80c1-e4ed8dabbed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.121388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1fd83715-71e2-49f6-80c1-e4ed8dabbed0 None None] MFA Rules not processed for user `94c7e57c93dd49a1a3e784002ae94fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:47.122593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1fd83715-71e2-49f6-80c1-e4ed8dabbed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.198178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 668/1330] 10.222.0.69 () {58 vars in 1062 bytes} [Thu Sep 1 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:47.207809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df378d-5031-47e7-933b-ee5d9d88905d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:47.209476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f8df378d-5031-47e7-933b-ee5d9d88905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.239679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:47.314211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df378d-5031-47e7-933b-ee5d9d88905d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:47.387039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea155c9-d725-4bfa-aeaf-342e57d4eda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:47.387665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea155c9-d725-4bfa-aeaf-342e57d4eda4 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.387942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea155c9-d725-4bfa-aeaf-342e57d4eda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.388215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea155c9-d725-4bfa-aeaf-342e57d4eda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.389799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bea155c9-d725-4bfa-aeaf-342e57d4eda4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.466467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:47.497281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea155c9-d725-4bfa-aeaf-342e57d4eda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:47.498714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea155c9-d725-4bfa-aeaf-342e57d4eda4 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:47.517624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 663/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:50.235049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1c9c-6101-487d-bd68-877b7f87dc93 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:50.235673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1c9c-6101-487d-bd68-877b7f87dc93 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:50.235673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1c9c-6101-487d-bd68-877b7f87dc93 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:50.236978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 669/1332] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:38:50.242456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af303a6-febf-4667-a37f-15b2e0b84f1b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:50.242887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af303a6-febf-4667-a37f-15b2e0b84f1b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:50.242988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af303a6-febf-4667-a37f-15b2e0b84f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:50.307149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6af303a6-febf-4667-a37f-15b2e0b84f1b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:50.308353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6af303a6-febf-4667-a37f-15b2e0b84f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:50.403210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 664/1333] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:50.692242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1c9c-6101-487d-bd68-877b7f87dc93 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:50.693978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e97f1c9c-6101-487d-bd68-877b7f87dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:50.771338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:50.804428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1c9c-6101-487d-bd68-877b7f87dc93 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:50.881231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef0eb2-9914-4927-b663-ee21379c9406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:50.881835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef0eb2-9914-4927-b663-ee21379c9406 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:50.882112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef0eb2-9914-4927-b663-ee21379c9406 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:50.882383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef0eb2-9914-4927-b663-ee21379c9406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:50.884031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-82ef0eb2-9914-4927-b663-ee21379c9406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:50.989844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef0eb2-9914-4927-b663-ee21379c9406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:50.991212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef0eb2-9914-4927-b663-ee21379c9406 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:51.001573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:51.009405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 670/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:52.951689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85908dde-44f4-4819-8ce2-93852b437ff8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:52.952200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85908dde-44f4-4819-8ce2-93852b437ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:52.952200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85908dde-44f4-4819-8ce2-93852b437ff8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:52.953521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 665/1335] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:52.958679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341c9c-48f4-40aa-8abd-858d6932323e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:52.959082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341c9c-48f4-40aa-8abd-858d6932323e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:52.959255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341c9c-48f4-40aa-8abd-858d6932323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:53.023778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-bc341c9c-48f4-40aa-8abd-858d6932323e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:53.024974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bc341c9c-48f4-40aa-8abd-858d6932323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:53.120224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 671/1336] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:53.403005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85908dde-44f4-4819-8ce2-93852b437ff8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:53.404593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-85908dde-44f4-4819-8ce2-93852b437ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:53.444328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:53.506570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85908dde-44f4-4819-8ce2-93852b437ff8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:53.578432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654845e0-7dc9-44cf-8003-f775580bc713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:53.579028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654845e0-7dc9-44cf-8003-f775580bc713 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:53.579337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654845e0-7dc9-44cf-8003-f775580bc713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:53.579612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654845e0-7dc9-44cf-8003-f775580bc713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:53.581189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-654845e0-7dc9-44cf-8003-f775580bc713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:53.665500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:53.691208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654845e0-7dc9-44cf-8003-f775580bc713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:53.692652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654845e0-7dc9-44cf-8003-f775580bc713 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:53.709960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 666/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:56.380533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f826-9567-4d37-b0aa-bebb8d7d9102 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:56.381095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f826-9567-4d37-b0aa-bebb8d7d9102 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:56.381095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f826-9567-4d37-b0aa-bebb8d7d9102 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:56.382330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 672/1338] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:56.387833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0805f-a61f-4af3-9a03-6d1f21bd94de None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:56.388240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0805f-a61f-4af3-9a03-6d1f21bd94de None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:56.388411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0805f-a61f-4af3-9a03-6d1f21bd94de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:56.452769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3bb0805f-a61f-4af3-9a03-6d1f21bd94de None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:56.453952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3bb0805f-a61f-4af3-9a03-6d1f21bd94de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:56.547553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 667/1339] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:56.835613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3f826-9567-4d37-b0aa-bebb8d7d9102 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:56.837164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4eb3f826-9567-4d37-b0aa-bebb8d7d9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:56.911518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:56.938366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3f826-9567-4d37-b0aa-bebb8d7d9102 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:57.011021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbf278-afc1-41cc-b9d4-e48dd3559b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:57.011653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf278-afc1-41cc-b9d4-e48dd3559b22 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:57.011931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf278-afc1-41cc-b9d4-e48dd3559b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:57.012207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf278-afc1-41cc-b9d4-e48dd3559b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:57.013791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3fbbf278-afc1-41cc-b9d4-e48dd3559b22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:57.122286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbf278-afc1-41cc-b9d4-e48dd3559b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:57.123752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbf278-afc1-41cc-b9d4-e48dd3559b22 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:57.142099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 673/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:01.441610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8b349-9cf9-4d1d-983d-0e4fbe9b4f57 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:01.442195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8b349-9cf9-4d1d-983d-0e4fbe9b4f57 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:01.442195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8b349-9cf9-4d1d-983d-0e4fbe9b4f57 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:01.443580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 668/1341] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:01.448844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d522134-2f2a-4dde-b040-87aa10acfd51 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:01.449232 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d522134-2f2a-4dde-b040-87aa10acfd51 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:01.449393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d522134-2f2a-4dde-b040-87aa10acfd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:01.455408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:01.518380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6d522134-2f2a-4dde-b040-87aa10acfd51 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:01.519634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6d522134-2f2a-4dde-b040-87aa10acfd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:01.615691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 674/1342] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:01.903117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8b349-9cf9-4d1d-983d-0e4fbe9b4f57 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:01.904702 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-97c8b349-9cf9-4d1d-983d-0e4fbe9b4f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:01.952498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:02.007268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8b349-9cf9-4d1d-983d-0e4fbe9b4f57 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:02.080953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bd475-22ee-48f9-a5e6-16387b899a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:02.081551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd475-22ee-48f9-a5e6-16387b899a2b service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:02.081823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd475-22ee-48f9-a5e6-16387b899a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:02.082089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd475-22ee-48f9-a5e6-16387b899a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:02.083783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c38bd475-22ee-48f9-a5e6-16387b899a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:02.181441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:02.197328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bd475-22ee-48f9-a5e6-16387b899a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:02.198839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bd475-22ee-48f9-a5e6-16387b899a2b service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:02.217207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 669/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:05.240465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b1ff6-16f6-4809-a007-a6b01b7ff7fd None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.240978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b1ff6-16f6-4809-a007-a6b01b7ff7fd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.240978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b1ff6-16f6-4809-a007-a6b01b7ff7fd None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.242263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 675/1344] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:05.247748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca66b02-9013-40ad-9601-92c7a9c09f79 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.248188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca66b02-9013-40ad-9601-92c7a9c09f79 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.248296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca66b02-9013-40ad-9601-92c7a9c09f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.316980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-dca66b02-9013-40ad-9601-92c7a9c09f79 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:05.318214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-dca66b02-9013-40ad-9601-92c7a9c09f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:05.416993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 670/1345] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:05.699852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b1ff6-16f6-4809-a007-a6b01b7ff7fd None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:05.701403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4c1b1ff6-16f6-4809-a007-a6b01b7ff7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:05.791310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:05.808729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b1ff6-16f6-4809-a007-a6b01b7ff7fd None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:05.888021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce122c2-5848-4173-8490-2a5786dbcd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:05.888621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce122c2-5848-4173-8490-2a5786dbcd3c service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.888897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce122c2-5848-4173-8490-2a5786dbcd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.889166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce122c2-5848-4173-8490-2a5786dbcd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.891306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4ce122c2-5848-4173-8490-2a5786dbcd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:05.998651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce122c2-5848-4173-8490-2a5786dbcd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:06.000059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce122c2-5848-4173-8490-2a5786dbcd3c service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:06.019216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 676/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:10.362332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77ead-0670-4f26-bf4d-720072b2dc3d None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:10.362864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77ead-0670-4f26-bf4d-720072b2dc3d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:10.363953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77ead-0670-4f26-bf4d-720072b2dc3d None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:10.367836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 671/1347] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:10.373644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5880-a770-4636-8629-84b222ecb567 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:10.374175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5880-a770-4636-8629-84b222ecb567 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:10.374175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5880-a770-4636-8629-84b222ecb567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:10.391028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:10.445316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-189b5880-a770-4636-8629-84b222ecb567 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:10.446546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-189b5880-a770-4636-8629-84b222ecb567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:10.548361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 677/1348] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:10.841115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f77ead-0670-4f26-bf4d-720072b2dc3d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:10.842920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-48f77ead-0670-4f26-bf4d-720072b2dc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:10.913958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:10.966149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f77ead-0670-4f26-bf4d-720072b2dc3d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:11.047281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e0bf7-a88a-41ef-8c54-e575df7868a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:11.047733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0bf7-a88a-41ef-8c54-e575df7868a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:11.048057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0bf7-a88a-41ef-8c54-e575df7868a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:11.048330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e0bf7-a88a-41ef-8c54-e575df7868a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:11.049958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7d8e0bf7-a88a-41ef-8c54-e575df7868a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:11.156704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:11.160421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0bf7-a88a-41ef-8c54-e575df7868a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:11.161912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e0bf7-a88a-41ef-8c54-e575df7868a8 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:11.179891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 672/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:16.107134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e27d0-7385-424f-8896-43310b2f3079 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:16.107823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e27d0-7385-424f-8896-43310b2f3079 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:16.107823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e27d0-7385-424f-8896-43310b2f3079 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:16.109324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 678/1350] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:16.114419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa324-67e9-4836-a76f-1efeab93fcc1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:16.114852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa324-67e9-4836-a76f-1efeab93fcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:16.114945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa324-67e9-4836-a76f-1efeab93fcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:16.213586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-226aa324-67e9-4836-a76f-1efeab93fcc1 None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:16.219185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-226aa324-67e9-4836-a76f-1efeab93fcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:16.376502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 673/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:39:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:20.547034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=59 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:20.659776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108276-1a89-4b06-a8ac-072c42276b6c None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:20.660078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108276-1a89-4b06-a8ac-072c42276b6c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:20.660350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108276-1a89-4b06-a8ac-072c42276b6c None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:20.661671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 679/1352] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:20.666955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795957-b764-4383-8e44-c83d8e1a85e8 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:20.667447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795957-b764-4383-8e44-c83d8e1a85e8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:20.667664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795957-b764-4383-8e44-c83d8e1a85e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:20.751928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:20.777133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2d795957-b764-4383-8e44-c83d8e1a85e8 None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:20.778459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2d795957-b764-4383-8e44-c83d8e1a85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:20.966560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 674/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:39:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:22.080683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d9333-12a4-48f0-aca5-d6f6a0177cf2 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:22.081220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d9333-12a4-48f0-aca5-d6f6a0177cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:22.081302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d9333-12a4-48f0-aca5-d6f6a0177cf2 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:22.082705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 680/1354] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:22.087866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4037aa-b2cd-487d-a1a8-ab8ab2a3a7d6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:22.088305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4037aa-b2cd-487d-a1a8-ab8ab2a3a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:22.088440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4037aa-b2cd-487d-a1a8-ab8ab2a3a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:22.167405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8a4037aa-b2cd-487d-a1a8-ab8ab2a3a7d6 None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:22.168659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8a4037aa-b2cd-487d-a1a8-ab8ab2a3a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:22.216097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:22.285568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 675/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:25.601859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbbb3-af73-4a20-853a-0d0d8325aee1 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:25.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbbb3-af73-4a20-853a-0d0d8325aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:25.602439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbbb3-af73-4a20-853a-0d0d8325aee1 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:25.603768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 681/1356] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:25.608823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f89b8-9426-4665-a14c-a03dc043c9e0 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:25.609380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f89b8-9426-4665-a14c-a03dc043c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:25.609380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f89b8-9426-4665-a14c-a03dc043c9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:25.691294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-bf3f89b8-9426-4665-a14c-a03dc043c9e0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:25.692486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bf3f89b8-9426-4665-a14c-a03dc043c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:25.808744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 676/1357] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:26.115483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe5166-31cf-4006-908b-e56b59997ca6 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.115728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe5166-31cf-4006-908b-e56b59997ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.116207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe5166-31cf-4006-908b-e56b59997ca6 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.117974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 682/1358] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 1 16:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:26.125653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1315-b307-4dbe-aa82-61f6266dcffc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.126130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1315-b307-4dbe-aa82-61f6266dcffc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.126546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1315-b307-4dbe-aa82-61f6266dcffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.145951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:26.215294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-08be1315-b307-4dbe-aa82-61f6266dcffc None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:26.216514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-08be1315-b307-4dbe-aa82-61f6266dcffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.337061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 677/1359] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 1 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:26.345461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe5166-31cf-4006-908b-e56b59997ca6 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.352709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-75fe5166-31cf-4006-908b-e56b59997ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.499966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe5166-31cf-4006-908b-e56b59997ca6 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:26.589267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:26.627364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717505b-ecc9-46b7-87cf-33aac0ca8398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:26.628158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717505b-ecc9-46b7-87cf-33aac0ca8398 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.628539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717505b-ecc9-46b7-87cf-33aac0ca8398 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.628911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717505b-ecc9-46b7-87cf-33aac0ca8398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.630678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4717505b-ecc9-46b7-87cf-33aac0ca8398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.731974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717505b-ecc9-46b7-87cf-33aac0ca8398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:26.734323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717505b-ecc9-46b7-87cf-33aac0ca8398 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:26.759201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 683/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:28.886299 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99094b6-23f5-4b01-a00f-6945b97c1a74 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:28.886807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99094b6-23f5-4b01-a00f-6945b97c1a74 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:28.886926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99094b6-23f5-4b01-a00f-6945b97c1a74 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:28.888412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 678/1361] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:28.894008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186b07-fd6f-40a9-90fc-1cbe9073a8e5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:28.894389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186b07-fd6f-40a9-90fc-1cbe9073a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:28.894601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186b07-fd6f-40a9-90fc-1cbe9073a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:28.965202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3f186b07-fd6f-40a9-90fc-1cbe9073a8e5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:28.966420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3f186b07-fd6f-40a9-90fc-1cbe9073a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:29.005289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:29.068819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 684/1362] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:29.367619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99094b6-23f5-4b01-a00f-6945b97c1a74 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:29.369448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c99094b6-23f5-4b01-a00f-6945b97c1a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:29.475764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:29.565617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99094b6-23f5-4b01-a00f-6945b97c1a74 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:29.694671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36630f92-0664-42a5-a597-3e00f4d2b475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:29.695199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36630f92-0664-42a5-a597-3e00f4d2b475 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:29.695675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36630f92-0664-42a5-a597-3e00f4d2b475 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:29.695945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36630f92-0664-42a5-a597-3e00f4d2b475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:29.697538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-36630f92-0664-42a5-a597-3e00f4d2b475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:29.721724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:29.790889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36630f92-0664-42a5-a597-3e00f4d2b475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:29.792540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36630f92-0664-42a5-a597-3e00f4d2b475 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:29.813231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 679/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:32.251095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4553a6-b3df-4deb-9188-48717af024d4 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.251663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4553a6-b3df-4deb-9188-48717af024d4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.251663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4553a6-b3df-4deb-9188-48717af024d4 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.253004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 685/1364] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:32.258408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b746a-c3b2-494b-87ca-6d843742ce44 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.258822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b746a-c3b2-494b-87ca-6d843742ce44 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.259024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b746a-c3b2-494b-87ca-6d843742ce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.328650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-912b746a-c3b2-494b-87ca-6d843742ce44 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:32.329860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-912b746a-c3b2-494b-87ca-6d843742ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:32.432985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:32.435936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 680/1365] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:32.732222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2e04-44a3-4244-879d-5621835072a1 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.732711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2e04-44a3-4244-879d-5621835072a1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.733212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2e04-44a3-4244-879d-5621835072a1 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.735425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 686/1366] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 1 16:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:32.741678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6acdd-6035-4f49-9e3d-04d234845012 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.742038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6acdd-6035-4f49-9e3d-04d234845012 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.742472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6acdd-6035-4f49-9e3d-04d234845012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.823689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-e2d6acdd-6035-4f49-9e3d-04d234845012 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:32.824919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e2d6acdd-6035-4f49-9e3d-04d234845012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:32.948446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 681/1367] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 1 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:32.956278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2e04-44a3-4244-879d-5621835072a1 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:32.957788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bf1b2e04-44a3-4244-879d-5621835072a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:33.116875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2e04-44a3-4244-879d-5621835072a1 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:33.138711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:33.240017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4d02f-01e1-4928-9b2b-eaae4cb12152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:33.240633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4d02f-01e1-4928-9b2b-eaae4cb12152 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.240908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4d02f-01e1-4928-9b2b-eaae4cb12152 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.241176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4d02f-01e1-4928-9b2b-eaae4cb12152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.242868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d1e4d02f-01e1-4928-9b2b-eaae4cb12152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:33.339492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4d02f-01e1-4928-9b2b-eaae4cb12152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:33.341117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4d02f-01e1-4928-9b2b-eaae4cb12152 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:33.361062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 687/1368] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:33.869111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2bf3-5d73-4795-9187-ff991271ddc6 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.869648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2bf3-5d73-4795-9187-ff991271ddc6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.869648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2bf3-5d73-4795-9187-ff991271ddc6 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.871194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 682/1369] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:33.877066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b88ee-dafb-45b0-9941-50ee4cf895ee None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.877358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b88ee-dafb-45b0-9941-50ee4cf895ee None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.877645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b88ee-dafb-45b0-9941-50ee4cf895ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.919363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:33.961158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-384b88ee-dafb-45b0-9941-50ee4cf895ee None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:33.963292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-384b88ee-dafb-45b0-9941-50ee4cf895ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:34.066277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 688/1370] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:34.659233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1b6c-c40f-4b1b-97cd-1f127b569903 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.659499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1b6c-c40f-4b1b-97cd-1f127b569903 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.659753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1b6c-c40f-4b1b-97cd-1f127b569903 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.661356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 683/1371] 10.222.0.69 () {54 vars in 964 bytes} [Thu Sep 1 16:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:34.666279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208f03c-0bd8-4f8c-a24c-919165e1ef8b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.666726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208f03c-0bd8-4f8c-a24c-919165e1ef8b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.666807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208f03c-0bd8-4f8c-a24c-919165e1ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.755899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d208f03c-0bd8-4f8c-a24c-919165e1ef8b None None] MFA Rules not processed for user `f5a7af0d09114d14a22cdb8291fe8b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:34.757110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d208f03c-0bd8-4f8c-a24c-919165e1ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:34.803697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:34.834669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 689/1372] 10.222.0.69 () {58 vars in 1061 bytes} [Thu Sep 1 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:34.842490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1b6c-c40f-4b1b-97cd-1f127b569903 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:34.844159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b3ce1b6c-c40f-4b1b-97cd-1f127b569903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:34.896251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:34.958748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1b6c-c40f-4b1b-97cd-1f127b569903 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:35.035277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c562d50-839c-4aed-a260-89983eed8cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:35.035883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c562d50-839c-4aed-a260-89983eed8cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:35.036159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c562d50-839c-4aed-a260-89983eed8cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:35.036429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c562d50-839c-4aed-a260-89983eed8cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:35.038055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3c562d50-839c-4aed-a260-89983eed8cc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:35.144254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:35.161111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c562d50-839c-4aed-a260-89983eed8cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:35.163023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c562d50-839c-4aed-a260-89983eed8cc4 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:35.186169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 684/1373] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:35.539718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22684c06-8679-47d6-8a03-17221d07a4f9 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:35.540114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22684c06-8679-47d6-8a03-17221d07a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:35.540476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22684c06-8679-47d6-8a03-17221d07a4f9 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:35.541976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 690/1374] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:35.547656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0bd99-c322-4d58-ab85-db09984864ef None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:35.547946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0bd99-c322-4d58-ab85-db09984864ef None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:35.548221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0bd99-c322-4d58-ab85-db09984864ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:35.613716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c5e0bd99-c322-4d58-ab85-db09984864ef None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:35.614931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c5e0bd99-c322-4d58-ab85-db09984864ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:35.712226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 685/1375] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:36.001593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22684c06-8679-47d6-8a03-17221d07a4f9 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:36.003116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-22684c06-8679-47d6-8a03-17221d07a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:36.150872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22684c06-8679-47d6-8a03-17221d07a4f9 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:36.202888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:36.264015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b16be-19c3-44c3-8d00-0074933d2827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:36.265222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b16be-19c3-44c3-8d00-0074933d2827 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:36.265500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b16be-19c3-44c3-8d00-0074933d2827 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:36.265770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b16be-19c3-44c3-8d00-0074933d2827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:36.267402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e91b16be-19c3-44c3-8d00-0074933d2827 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:36.356731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b16be-19c3-44c3-8d00-0074933d2827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:36.358309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b16be-19c3-44c3-8d00-0074933d2827 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:36.377741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 691/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:38.468850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b87f01-59bf-4ea4-9f6c-ed17978dd94f None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:38.469337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b87f01-59bf-4ea4-9f6c-ed17978dd94f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:38.469337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b87f01-59bf-4ea4-9f6c-ed17978dd94f None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:38.470653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 686/1377] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:38.475814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38a96-a344-47a3-a2e8-52b318b1b186 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:38.476263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38a96-a344-47a3-a2e8-52b318b1b186 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:38.476361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c38a96-a344-47a3-a2e8-52b318b1b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:38.544544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c5c38a96-a344-47a3-a2e8-52b318b1b186 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:38.545746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c5c38a96-a344-47a3-a2e8-52b318b1b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:38.553857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:38.642007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 692/1378] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:38.949505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b87f01-59bf-4ea4-9f6c-ed17978dd94f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:38.950832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-55b87f01-59bf-4ea4-9f6c-ed17978dd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:39.021833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:39.120948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b87f01-59bf-4ea4-9f6c-ed17978dd94f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:39.248467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be5d9-3152-4d33-b5ca-dacbef8a2299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:39.250196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be5d9-3152-4d33-b5ca-dacbef8a2299 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:39.250484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be5d9-3152-4d33-b5ca-dacbef8a2299 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:39.250757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be5d9-3152-4d33-b5ca-dacbef8a2299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:39.252481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b20be5d9-3152-4d33-b5ca-dacbef8a2299 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:39.274259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:39.350419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20be5d9-3152-4d33-b5ca-dacbef8a2299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:39.352159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20be5d9-3152-4d33-b5ca-dacbef8a2299 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:39.371096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 687/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:41.436308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd42e-d8f6-4042-a6df-4e5ef6919008 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:41.436826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd42e-d8f6-4042-a6df-4e5ef6919008 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:41.436826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd42e-d8f6-4042-a6df-4e5ef6919008 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:41.438257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 693/1380] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:41.443220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7b7f-4f70-4bca-b684-bfa3caaa3ee5 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:41.443644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7b7f-4f70-4bca-b684-bfa3caaa3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:41.443822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7b7f-4f70-4bca-b684-bfa3caaa3ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:41.511469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-e47b7b7f-4f70-4bca-b684-bfa3caaa3ee5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:41.512655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e47b7b7f-4f70-4bca-b684-bfa3caaa3ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:41.609227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:41.615466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 688/1381] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:41.911311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd42e-d8f6-4042-a6df-4e5ef6919008 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:41.912825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d2dcd42e-d8f6-4042-a6df-4e5ef6919008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:42.067591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:42.080269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd42e-d8f6-4042-a6df-4e5ef6919008 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:42.206304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02326-6107-4f90-b05c-078e85c3e507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:42.206880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02326-6107-4f90-b05c-078e85c3e507 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:42.207184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02326-6107-4f90-b05c-078e85c3e507 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:42.207466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02326-6107-4f90-b05c-078e85c3e507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:42.209133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7ff02326-6107-4f90-b05c-078e85c3e507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:42.302247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff02326-6107-4f90-b05c-078e85c3e507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:42.303907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff02326-6107-4f90-b05c-078e85c3e507 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:42.315371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:42.323722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 694/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:44.760359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bb9b-2271-49c3-ae1a-16f8a65b368e None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:44.760883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bb9b-2271-49c3-ae1a-16f8a65b368e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:44.760883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bb9b-2271-49c3-ae1a-16f8a65b368e None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:44.762238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 689/1383] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:44.769044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c36d7-8b78-4dc4-bcb9-7805ce68bc6b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:44.769454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c36d7-8b78-4dc4-bcb9-7805ce68bc6b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:44.769597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c36d7-8b78-4dc4-bcb9-7805ce68bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:44.836041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a77c36d7-8b78-4dc4-bcb9-7805ce68bc6b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:44.837268 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a77c36d7-8b78-4dc4-bcb9-7805ce68bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:44.939588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 695/1384] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:45.234463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bb9b-2271-49c3-ae1a-16f8a65b368e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.236075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b683bb9b-2271-49c3-ae1a-16f8a65b368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.393450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bb9b-2271-49c3-ae1a-16f8a65b368e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.474714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:45.521045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bfcb1-abd3-4e4a-aebc-cca58c0e30a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.521654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bfcb1-abd3-4e4a-aebc-cca58c0e30a5 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.521927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bfcb1-abd3-4e4a-aebc-cca58c0e30a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.522194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bfcb1-abd3-4e4a-aebc-cca58c0e30a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.523848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-514bfcb1-abd3-4e4a-aebc-cca58c0e30a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.616066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bfcb1-abd3-4e4a-aebc-cca58c0e30a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.617708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bfcb1-abd3-4e4a-aebc-cca58c0e30a5 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.636198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 690/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:47.902997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a87232-256d-49ba-a2d5-655dd2153a22 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.903558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a87232-256d-49ba-a2d5-655dd2153a22 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.903653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a87232-256d-49ba-a2d5-655dd2153a22 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.906016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 696/1386] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:47.911386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b0025-a74e-4205-8e61-12e0b4a2f89a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.911799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b0025-a74e-4205-8e61-12e0b4a2f89a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.911914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b0025-a74e-4205-8e61-12e0b4a2f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.977827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d89b0025-a74e-4205-8e61-12e0b4a2f89a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:47.979041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d89b0025-a74e-4205-8e61-12e0b4a2f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:48.012739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:48.077248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 691/1387] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:48.380969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a87232-256d-49ba-a2d5-655dd2153a22 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:48.382499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-78a87232-256d-49ba-a2d5-655dd2153a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:48.459956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:48.534340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a87232-256d-49ba-a2d5-655dd2153a22 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:48.666653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38d96-ae82-47ba-b9ac-3aef76c1b646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:48.667470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38d96-ae82-47ba-b9ac-3aef76c1b646 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:48.667842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38d96-ae82-47ba-b9ac-3aef76c1b646 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:48.668419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38d96-ae82-47ba-b9ac-3aef76c1b646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:48.670523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-19f38d96-ae82-47ba-b9ac-3aef76c1b646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:48.713881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:48.767882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38d96-ae82-47ba-b9ac-3aef76c1b646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:48.769562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38d96-ae82-47ba-b9ac-3aef76c1b646 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:48.787412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 697/1388] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:50.861775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036a888-6648-49f8-9a86-4d227a8b3686 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.862366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036a888-6648-49f8-9a86-4d227a8b3686 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.862366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036a888-6648-49f8-9a86-4d227a8b3686 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.863729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 692/1389] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:50.869021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14a57-9d94-4978-8168-808f08858cfd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.869477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14a57-9d94-4978-8168-808f08858cfd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.869585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14a57-9d94-4978-8168-808f08858cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.936283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c7f14a57-9d94-4978-8168-808f08858cfd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:50.937423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c7f14a57-9d94-4978-8168-808f08858cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.032648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 698/1390] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:51.320160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036a888-6648-49f8-9a86-4d227a8b3686 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.321819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9036a888-6648-49f8-9a86-4d227a8b3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.361569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d6136-0dd6-444c-a271-267eb9a601f8 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.361853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d6136-0dd6-444c-a271-267eb9a601f8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.362128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d6136-0dd6-444c-a271-267eb9a601f8 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.363510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 699/1391] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:39:51.368287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9c4e0-41d0-4fec-8ce0-73066ac4ad02 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.368565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9c4e0-41d0-4fec-8ce0-73066ac4ad02 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.368832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9c4e0-41d0-4fec-8ce0-73066ac4ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.385043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:51.436954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f9a9c4e0-41d0-4fec-8ce0-73066ac4ad02 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:51.438172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f9a9c4e0-41d0-4fec-8ce0-73066ac4ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.473829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036a888-6648-49f8-9a86-4d227a8b3686 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.492769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:51.537111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 700/1392] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:51.591086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ef349-7067-4274-88df-3ab6ba22186f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.591690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ef349-7067-4274-88df-3ab6ba22186f service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.591948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ef349-7067-4274-88df-3ab6ba22186f service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.592218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ef349-7067-4274-88df-3ab6ba22186f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.593798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3d4ef349-7067-4274-88df-3ab6ba22186f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.685605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ef349-7067-4274-88df-3ab6ba22186f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.687768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ef349-7067-4274-88df-3ab6ba22186f service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.705773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 693/1393] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:51.837152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7be90-bd78-471d-b990-24f3d4c6c119 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.837438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7be90-bd78-471d-b990-24f3d4c6c119 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.837715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7be90-bd78-471d-b990-24f3d4c6c119 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.839263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 701/1394] 10.222.0.69 () {54 vars in 967 bytes} [Thu Sep 1 16:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:51.844204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0029be-c6c0-4ab2-b4ff-6776f8626a9a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.844430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0029be-c6c0-4ab2-b4ff-6776f8626a9a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.844704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0029be-c6c0-4ab2-b4ff-6776f8626a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.869821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:51.921004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-da0029be-c6c0-4ab2-b4ff-6776f8626a9a None None] MFA Rules not processed for user `6a2b14464bea4a81b2995c6f9289ec73`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:51.922212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-da0029be-c6c0-4ab2-b4ff-6776f8626a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:52.005566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 694/1395] 10.222.0.69 () {58 vars in 1064 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:52.013491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7be90-bd78-471d-b990-24f3d4c6c119 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:52.015385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fdb7be90-bd78-471d-b990-24f3d4c6c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:52.122472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:52.129592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7be90-bd78-471d-b990-24f3d4c6c119 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:52.205494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62518049-dcc7-46b5-a0ab-020af94175b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:52.206296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62518049-dcc7-46b5-a0ab-020af94175b4 service glance] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:52.206703 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62518049-dcc7-46b5-a0ab-020af94175b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:52.207086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62518049-dcc7-46b5-a0ab-020af94175b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:52.208906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-62518049-dcc7-46b5-a0ab-020af94175b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:52.318910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62518049-dcc7-46b5-a0ab-020af94175b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:52.320407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62518049-dcc7-46b5-a0ab-020af94175b4 service glance] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:52.339281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 702/1396] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:53.296425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9896b-01d6-489b-a238-6129a37f2ccf None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:53.296953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9896b-01d6-489b-a238-6129a37f2ccf None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:53.296953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9896b-01d6-489b-a238-6129a37f2ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:53.363468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ace9896b-01d6-489b-a238-6129a37f2ccf None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:53.364677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ace9896b-01d6-489b-a238-6129a37f2ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:53.426328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:53.454178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 695/1397] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:53.503077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7d5be-f8d7-4e0b-b185-6c179c275f6e None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:53.503646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7d5be-f8d7-4e0b-b185-6c179c275f6e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:53.503807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7d5be-f8d7-4e0b-b185-6c179c275f6e None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:53.505127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 703/1398] 10.222.0.69 () {54 vars in 943 bytes} [Thu Sep 1 16:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:53.511964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fe396-0b46-4d1e-9598-c969f0f749c1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:53.512250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fe396-0b46-4d1e-9598-c969f0f749c1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:53.512521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fe396-0b46-4d1e-9598-c969f0f749c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:53.587976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-760fe396-0b46-4d1e-9598-c969f0f749c1 None None] MFA Rules not processed for user `4a6f6e719b6f49828fb866b4795e7108`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:53.589189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-760fe396-0b46-4d1e-9598-c969f0f749c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:53.696760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 696/1399] 10.222.0.69 () {58 vars in 1040 bytes} [Thu Sep 1 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:53.706186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7d5be-f8d7-4e0b-b185-6c179c275f6e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:53.707830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5aa7d5be-f8d7-4e0b-b185-6c179c275f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:53.731246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:53.835494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034163-2ebe-47e2-9179-c6fcf45fd369 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:53.835860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034163-2ebe-47e2-9179-c6fcf45fd369 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:53.836040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034163-2ebe-47e2-9179-c6fcf45fd369 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:53.837556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 697/1400] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:39:53.842842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:53.843128 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:53.843422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:53.844958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7d5be-f8d7-4e0b-b185-6c179c275f6e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:53.888110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:53.913081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:53.914297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:53.961457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c70d0-3169-41f9-aaf5-5f5e4510a223 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:53.961987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c70d0-3169-41f9-aaf5-5f5e4510a223 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:53.962268 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c70d0-3169-41f9-aaf5-5f5e4510a223 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:53.962597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c70d0-3169-41f9-aaf5-5f5e4510a223 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:53.964950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9a9c70d0-3169-41f9-aaf5-5f5e4510a223 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:53.977531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:54.020106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 698/1401] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:54.061018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c70d0-3169-41f9-aaf5-5f5e4510a223 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:54.062655 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c70d0-3169-41f9-aaf5-5f5e4510a223 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:54.071202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 704/1402] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:39:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:54.310272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:54.312220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:54.426271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab498d4-ea7b-4c7f-8c5c-951290ea4f9a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:54.429953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:54.557203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24bc63-7dae-4b90-ae0e-ed329f8ecd78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:54.557725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bc63-7dae-4b90-ae0e-ed329f8ecd78 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:54.558002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bc63-7dae-4b90-ae0e-ed329f8ecd78 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:54.558267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bc63-7dae-4b90-ae0e-ed329f8ecd78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:54.561356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8c24bc63-7dae-4b90-ae0e-ed329f8ecd78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:54.663866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24bc63-7dae-4b90-ae0e-ed329f8ecd78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:54.665572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24bc63-7dae-4b90-ae0e-ed329f8ecd78 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:54.684428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 699/1403] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:56.770483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451789ed-588e-4a18-a0ee-367877ca73fb None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:56.771056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451789ed-588e-4a18-a0ee-367877ca73fb None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:56.771056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451789ed-588e-4a18-a0ee-367877ca73fb None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:56.773455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 705/1404] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:39:56.777490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeb88c-e66a-433f-8c3d-7cff8daf36c5 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:56.777915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeb88c-e66a-433f-8c3d-7cff8daf36c5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:56.778069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeb88c-e66a-433f-8c3d-7cff8daf36c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:56.789872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:56.850557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-40eeb88c-e66a-433f-8c3d-7cff8daf36c5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:56.851910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-40eeb88c-e66a-433f-8c3d-7cff8daf36c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:56.959438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 700/1405] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:57.253729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451789ed-588e-4a18-a0ee-367877ca73fb None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:57.255284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-451789ed-588e-4a18-a0ee-367877ca73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:57.437853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451789ed-588e-4a18-a0ee-367877ca73fb None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:57.441146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:57.567825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d4735-79cd-458c-ae34-a62c707fed56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:57.568842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d4735-79cd-458c-ae34-a62c707fed56 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:57.569118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d4735-79cd-458c-ae34-a62c707fed56 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:57.569390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d4735-79cd-458c-ae34-a62c707fed56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:57.571027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7f0d4735-79cd-458c-ae34-a62c707fed56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:57.672879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d4735-79cd-458c-ae34-a62c707fed56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:57.674808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d4735-79cd-458c-ae34-a62c707fed56 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:57.703882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 706/1406] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:59.837241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743dc73-91d8-49a3-84cc-6004fa271786 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:59.837768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743dc73-91d8-49a3-84cc-6004fa271786 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:59.837768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743dc73-91d8-49a3-84cc-6004fa271786 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:59.840520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 701/1407] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:39:59.846435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402c4eb-9ec0-4b4d-b9da-f3b53cab5e9c None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:59.846899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402c4eb-9ec0-4b4d-b9da-f3b53cab5e9c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:59.847005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402c4eb-9ec0-4b4d-b9da-f3b53cab5e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:59.857488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:59.921182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4402c4eb-9ec0-4b4d-b9da-f3b53cab5e9c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:59.922620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4402c4eb-9ec0-4b4d-b9da-f3b53cab5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:00.030126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 707/1408] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:00.322431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743dc73-91d8-49a3-84cc-6004fa271786 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:00.324004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b743dc73-91d8-49a3-84cc-6004fa271786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:00.417523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:00.486234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743dc73-91d8-49a3-84cc-6004fa271786 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:00.617152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068f8f8-7b0e-4624-a465-5528fb3b1020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:00.617152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f8f8-7b0e-4624-a465-5528fb3b1020 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:00.617152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f8f8-7b0e-4624-a465-5528fb3b1020 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:00.617152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068f8f8-7b0e-4624-a465-5528fb3b1020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:00.617913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4068f8f8-7b0e-4624-a465-5528fb3b1020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:00.679583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:00.730447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f8f8-7b0e-4624-a465-5528fb3b1020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:00.733170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068f8f8-7b0e-4624-a465-5528fb3b1020 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:00.753477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 702/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:10.027922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=62 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:10.751092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=23 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:17.924542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1336a-ebf7-4b83-b060-867a976d05bc None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.925083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1336a-ebf7-4b83-b060-867a976d05bc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.925083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1336a-ebf7-4b83-b060-867a976d05bc None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:17.926406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 708/1410] 10.222.0.69 () {54 vars in 918 bytes} [Thu Sep 1 16:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:17.931857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f356f94-117f-4d92-9a2b-9c2e4b3174d6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:17.932305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f356f94-117f-4d92-9a2b-9c2e4b3174d6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:17.932416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f356f94-117f-4d92-9a2b-9c2e4b3174d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:18.006254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-7f356f94-117f-4d92-9a2b-9c2e4b3174d6 None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:18.007470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7f356f94-117f-4d92-9a2b-9c2e4b3174d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:18.111931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 703/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Sep 1 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:18.126350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f1b36-71c0-45c0-b387-d18d951f039a None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:18.126654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f1b36-71c0-45c0-b387-d18d951f039a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:18.126918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f1b36-71c0-45c0-b387-d18d951f039a None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:18.128390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 709/1412] 10.222.0.69 () {54 vars in 918 bytes} [Thu Sep 1 16:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:18.133004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd389-ec7a-4169-b9c7-4b97858d74b1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:18.133292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd389-ec7a-4169-b9c7-4b97858d74b1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:18.133567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd389-ec7a-4169-b9c7-4b97858d74b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:18.206708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:18.209298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-f94dd389-ec7a-4169-b9c7-4b97858d74b1 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:18.210501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f94dd389-ec7a-4169-b9c7-4b97858d74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:18.331229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 704/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Sep 1 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:20.717737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd65a8-8dda-4614-8ca4-3dc0304f0114 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:20.718305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd65a8-8dda-4614-8ca4-3dc0304f0114 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:20.718305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd65a8-8dda-4614-8ca4-3dc0304f0114 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:20.719580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:20.724679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9302ba-5570-4324-a58e-f624f3b5d13d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:20.725074 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9302ba-5570-4324-a58e-f624f3b5d13d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:20.725218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9302ba-5570-4324-a58e-f624f3b5d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:20.790490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0c9302ba-5570-4324-a58e-f624f3b5d13d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:20.791735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0c9302ba-5570-4324-a58e-f624f3b5d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:20.845471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:20.887806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:21.177423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd65a8-8dda-4614-8ca4-3dc0304f0114 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:21.178907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-31cd65a8-8dda-4614-8ca4-3dc0304f0114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:21.326298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd65a8-8dda-4614-8ca4-3dc0304f0114 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:21.398610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:21.438105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2508a-3ebf-42ec-aecf-968a18b2007f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:21.438653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2508a-3ebf-42ec-aecf-968a18b2007f service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:21.438915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2508a-3ebf-42ec-aecf-968a18b2007f service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:21.439207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2508a-3ebf-42ec-aecf-968a18b2007f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:21.440816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-77a2508a-3ebf-42ec-aecf-968a18b2007f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:21.528042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2508a-3ebf-42ec-aecf-968a18b2007f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:21.529678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2508a-3ebf-42ec-aecf-968a18b2007f service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:21.547816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 711/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:22.432786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce77d3-c835-4544-b898-da18ee0a73a8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:22.433361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce77d3-c835-4544-b898-da18ee0a73a8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:22.433361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce77d3-c835-4544-b898-da18ee0a73a8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:22.434684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:22.440193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77920-1972-4465-8d5d-7fa3d547e811 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:22.440605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77920-1972-4465-8d5d-7fa3d547e811 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:22.440745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77920-1972-4465-8d5d-7fa3d547e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:22.515230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4ba77920-1972-4465-8d5d-7fa3d547e811 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:22.516456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4ba77920-1972-4465-8d5d-7fa3d547e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:22.542443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:22.611675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:22.764328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce77d3-c835-4544-b898-da18ee0a73a8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:22.765890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-75ce77d3-c835-4544-b898-da18ee0a73a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:22.909972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce77d3-c835-4544-b898-da18ee0a73a8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:22.948376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:23.021331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a4cf-9f57-43ea-b580-9f2ac74a0140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:23.021921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a4cf-9f57-43ea-b580-9f2ac74a0140 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:23.022191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a4cf-9f57-43ea-b580-9f2ac74a0140 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:23.022455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a4cf-9f57-43ea-b580-9f2ac74a0140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:23.024059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7ef1a4cf-9f57-43ea-b580-9f2ac74a0140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:23.112246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1a4cf-9f57-43ea-b580-9f2ac74a0140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:23.113838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1a4cf-9f57-43ea-b580-9f2ac74a0140 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:23.131490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 707/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:24.011710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209ad0-2341-4d04-8cac-205339e06b11 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:24.012278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209ad0-2341-4d04-8cac-205339e06b11 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:24.012383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209ad0-2341-4d04-8cac-205339e06b11 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:24.013725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:24.018695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75719db8-fcd4-4ae0-96a7-03ca9daefdf0 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:24.019112 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75719db8-fcd4-4ae0-96a7-03ca9daefdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:24.019256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75719db8-fcd4-4ae0-96a7-03ca9daefdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:24.073784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:24.095578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-75719db8-fcd4-4ae0-96a7-03ca9daefdf0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:24.096797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-75719db8-fcd4-4ae0-96a7-03ca9daefdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:24.193399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:24.343918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209ad0-2341-4d04-8cac-205339e06b11 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:24.345473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-24209ad0-2341-4d04-8cac-205339e06b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:24.489438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209ad0-2341-4d04-8cac-205339e06b11 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:24.501706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:24.599624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271b4c6-b28b-41cb-bbcc-72b65f5052e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:24.600221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271b4c6-b28b-41cb-bbcc-72b65f5052e8 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:24.600517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271b4c6-b28b-41cb-bbcc-72b65f5052e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:24.600780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271b4c6-b28b-41cb-bbcc-72b65f5052e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:24.602347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b271b4c6-b28b-41cb-bbcc-72b65f5052e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:24.690778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271b4c6-b28b-41cb-bbcc-72b65f5052e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:24.692407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271b4c6-b28b-41cb-bbcc-72b65f5052e8 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:24.710241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 714/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:25.563438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345370e-fa7c-4eb9-859f-76df5f359834 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:25.563880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345370e-fa7c-4eb9-859f-76df5f359834 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:25.563999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345370e-fa7c-4eb9-859f-76df5f359834 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:25.565351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:25.570376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cda47-7b5d-4ca2-a8a7-21e998dbbd0b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:25.570785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cda47-7b5d-4ca2-a8a7-21e998dbbd0b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:25.570919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cda47-7b5d-4ca2-a8a7-21e998dbbd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:25.590797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:25.647932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6b6cda47-7b5d-4ca2-a8a7-21e998dbbd0b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:25.649152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6b6cda47-7b5d-4ca2-a8a7-21e998dbbd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:25.744260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:40:25.900246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345370e-fa7c-4eb9-859f-76df5f359834 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:25.901693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8345370e-fa7c-4eb9-859f-76df5f359834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:26.009869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:26.045981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345370e-fa7c-4eb9-859f-76df5f359834 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:26.158155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a0136-7047-4caa-8a42-baf7bd330bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:26.158675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a0136-7047-4caa-8a42-baf7bd330bd8 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:26.158953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a0136-7047-4caa-8a42-baf7bd330bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:26.159257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a0136-7047-4caa-8a42-baf7bd330bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:26.160855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e84a0136-7047-4caa-8a42-baf7bd330bd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:26.236087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:26.249590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a0136-7047-4caa-8a42-baf7bd330bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:26.251217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a0136-7047-4caa-8a42-baf7bd330bd8 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:26.268950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 710/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:27.130985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106fa1-c8f7-40ef-8ca6-9c9ce9feaf60 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:27.131467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106fa1-c8f7-40ef-8ca6-9c9ce9feaf60 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:27.131575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106fa1-c8f7-40ef-8ca6-9c9ce9feaf60 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:27.132937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:27.137988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2b6f8-5a79-4f6e-9a60-4cf25340ea39 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:27.138422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2b6f8-5a79-4f6e-9a60-4cf25340ea39 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:27.138539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2b6f8-5a79-4f6e-9a60-4cf25340ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:27.213983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1af2b6f8-5a79-4f6e-9a60-4cf25340ea39 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:27.215282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1af2b6f8-5a79-4f6e-9a60-4cf25340ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:27.310315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:27.462701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4106fa1-c8f7-40ef-8ca6-9c9ce9feaf60 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:27.464247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b4106fa1-c8f7-40ef-8ca6-9c9ce9feaf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:27.549565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:27.609336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4106fa1-c8f7-40ef-8ca6-9c9ce9feaf60 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:27.722652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5564ec-48fa-4a31-aeaf-6444c084eedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:27.723309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5564ec-48fa-4a31-aeaf-6444c084eedd service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:27.723648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5564ec-48fa-4a31-aeaf-6444c084eedd service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:27.723898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5564ec-48fa-4a31-aeaf-6444c084eedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:27.726781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6f5564ec-48fa-4a31-aeaf-6444c084eedd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:27.781390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:27.823908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5564ec-48fa-4a31-aeaf-6444c084eedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:27.825651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5564ec-48fa-4a31-aeaf-6444c084eedd service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:27.845802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 717/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:28.760935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244d18-9127-4ad9-a2e4-24149bdf5526 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:28.761371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244d18-9127-4ad9-a2e4-24149bdf5526 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:28.761472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244d18-9127-4ad9-a2e4-24149bdf5526 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:28.762799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:28.767684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c46a7f-c903-488f-b404-4f78459a9f51 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:28.768109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c46a7f-c903-488f-b404-4f78459a9f51 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:28.768214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c46a7f-c903-488f-b404-4f78459a9f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:28.844447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e4c46a7f-c903-488f-b404-4f78459a9f51 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:28.845652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e4c46a7f-c903-488f-b404-4f78459a9f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:28.943394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:29.094593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244d18-9127-4ad9-a2e4-24149bdf5526 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:29.096194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-db244d18-9127-4ad9-a2e4-24149bdf5526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:29.147075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.242290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244d18-9127-4ad9-a2e4-24149bdf5526 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:29.355191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2098db-a27a-427d-8ee1-b3336d2a9b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:29.355794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2098db-a27a-427d-8ee1-b3336d2a9b3a service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:29.356068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2098db-a27a-427d-8ee1-b3336d2a9b3a service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:29.356334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2098db-a27a-427d-8ee1-b3336d2a9b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:29.358471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6e2098db-a27a-427d-8ee1-b3336d2a9b3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:29.365251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.445936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2098db-a27a-427d-8ee1-b3336d2a9b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:29.447612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2098db-a27a-427d-8ee1-b3336d2a9b3a service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:29.465815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 713/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:30.343053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b882-2d53-458c-a731-83479e1bab8d None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:30.343647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b882-2d53-458c-a731-83479e1bab8d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:30.343647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b882-2d53-458c-a731-83479e1bab8d None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:30.345006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:30.350277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87dc2-0619-46f0-9b00-b59c3d1d580b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:30.350701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87dc2-0619-46f0-9b00-b59c3d1d580b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:30.350819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87dc2-0619-46f0-9b00-b59c3d1d580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:30.425206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-83e87dc2-0619-46f0-9b00-b59c3d1d580b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:30.426400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-83e87dc2-0619-46f0-9b00-b59c3d1d580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:30.492438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:30.521077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:30.672798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7b882-2d53-458c-a731-83479e1bab8d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:30.674331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-15b7b882-2d53-458c-a731-83479e1bab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:30.692440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:30.819797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7b882-2d53-458c-a731-83479e1bab8d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:30.906055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:30.930734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75a16f-de0c-4ca9-bbde-d9917a16243a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:30.944256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75a16f-de0c-4ca9-bbde-d9917a16243a service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:30.944256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75a16f-de0c-4ca9-bbde-d9917a16243a service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:30.944256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75a16f-de0c-4ca9-bbde-d9917a16243a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:30.944256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1b75a16f-de0c-4ca9-bbde-d9917a16243a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:31.023006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75a16f-de0c-4ca9-bbde-d9917a16243a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:31.024636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75a16f-de0c-4ca9-bbde-d9917a16243a service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:31.042193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 720/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:31.920205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb630d-d7a6-4986-ba11-80246e77fa55 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:31.920767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb630d-d7a6-4986-ba11-80246e77fa55 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:31.920767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb630d-d7a6-4986-ba11-80246e77fa55 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:31.921999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:31.927080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07715bcc-dc8a-4010-99f2-369ce98ef43d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:31.927524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07715bcc-dc8a-4010-99f2-369ce98ef43d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:31.927659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07715bcc-dc8a-4010-99f2-369ce98ef43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:32.003813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-07715bcc-dc8a-4010-99f2-369ce98ef43d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:32.032397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-07715bcc-dc8a-4010-99f2-369ce98ef43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:32.048217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:32.103585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:32.257991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb630d-d7a6-4986-ba11-80246e77fa55 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:32.259774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9abb630d-d7a6-4986-ba11-80246e77fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:32.406119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb630d-d7a6-4986-ba11-80246e77fa55 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:32.458982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:32.518675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec3f5f-8e92-420b-86b2-60e13fb7b415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:32.519329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec3f5f-8e92-420b-86b2-60e13fb7b415 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:32.519608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec3f5f-8e92-420b-86b2-60e13fb7b415 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:32.519877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec3f5f-8e92-420b-86b2-60e13fb7b415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:32.521459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c9ec3f5f-8e92-420b-86b2-60e13fb7b415 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:32.609231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec3f5f-8e92-420b-86b2-60e13fb7b415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:32.610823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec3f5f-8e92-420b-86b2-60e13fb7b415 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:32.628463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 716/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:33.479348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab054-0829-4953-a6f7-e145de7f7654 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:33.479925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab054-0829-4953-a6f7-e145de7f7654 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:33.479925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab054-0829-4953-a6f7-e145de7f7654 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:33.481258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:33.486574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ddf83-a06e-4660-9c68-3c84c687220b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:33.486966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ddf83-a06e-4660-9c68-3c84c687220b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:33.487122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ddf83-a06e-4660-9c68-3c84c687220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:33.563700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ec3ddf83-a06e-4660-9c68-3c84c687220b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:33.564894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ec3ddf83-a06e-4660-9c68-3c84c687220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:33.566895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:33.661916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:33.814821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ab054-0829-4953-a6f7-e145de7f7654 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:33.816376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-308ab054-0829-4953-a6f7-e145de7f7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:33.964404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ab054-0829-4953-a6f7-e145de7f7654 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:33.990218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:34.074886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d705af-583f-4bbe-b80e-59eea3bb1a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:34.076061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d705af-583f-4bbe-b80e-59eea3bb1a17 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:34.076332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d705af-583f-4bbe-b80e-59eea3bb1a17 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:34.076653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d705af-583f-4bbe-b80e-59eea3bb1a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:34.078322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-19d705af-583f-4bbe-b80e-59eea3bb1a17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:34.180306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d705af-583f-4bbe-b80e-59eea3bb1a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:34.181897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d705af-583f-4bbe-b80e-59eea3bb1a17 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:34.199945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 723/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:36.031717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65e9f-b4d6-4657-b156-b3e40e19c382 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:36.032268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65e9f-b4d6-4657-b156-b3e40e19c382 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:36.032268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65e9f-b4d6-4657-b156-b3e40e19c382 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:36.033607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:36.038777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504611-ab65-4cd9-916a-42862c3ccf72 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:36.039214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504611-ab65-4cd9-916a-42862c3ccf72 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:36.039342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504611-ab65-4cd9-916a-42862c3ccf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:36.081082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:36.107123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-35504611-ab65-4cd9-916a-42862c3ccf72 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:36.109122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-35504611-ab65-4cd9-916a-42862c3ccf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:36.206255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:36.492320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d65e9f-b4d6-4657-b156-b3e40e19c382 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:36.493861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-96d65e9f-b4d6-4657-b156-b3e40e19c382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:36.598646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d65e9f-b4d6-4657-b156-b3e40e19c382 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:36.630522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:36.671944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b1e59-c5f8-480f-836c-dde63044656b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:36.672543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b1e59-c5f8-480f-836c-dde63044656b service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:36.672820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b1e59-c5f8-480f-836c-dde63044656b service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:36.673089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b1e59-c5f8-480f-836c-dde63044656b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:36.674673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b76b1e59-c5f8-480f-836c-dde63044656b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:36.783836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b1e59-c5f8-480f-836c-dde63044656b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:36.785269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b1e59-c5f8-480f-836c-dde63044656b service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:36.803111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 719/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:38.864895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc738d2-f883-4e83-bcf9-4668731e2712 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:38.865427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc738d2-f883-4e83-bcf9-4668731e2712 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:38.865427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc738d2-f883-4e83-bcf9-4668731e2712 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:38.866888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:38.873042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0737e4-f7f8-45c8-a655-3670166ff785 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:38.873488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0737e4-f7f8-45c8-a655-3670166ff785 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:38.873614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0737e4-f7f8-45c8-a655-3670166ff785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:38.938707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3b0737e4-f7f8-45c8-a655-3670166ff785 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:38.939875 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3b0737e4-f7f8-45c8-a655-3670166ff785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:38.952229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:39.034311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:39.318260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc738d2-f883-4e83-bcf9-4668731e2712 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:39.319821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2bc738d2-f883-4e83-bcf9-4668731e2712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:39.424560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc738d2-f883-4e83-bcf9-4668731e2712 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:39.436633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:39.616390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374894e-e001-4afe-bc52-205ff58bae34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:39.616899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374894e-e001-4afe-bc52-205ff58bae34 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:39.617170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374894e-e001-4afe-bc52-205ff58bae34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:39.617434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374894e-e001-4afe-bc52-205ff58bae34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:39.619020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2374894e-e001-4afe-bc52-205ff58bae34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:39.726079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374894e-e001-4afe-bc52-205ff58bae34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:39.727530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374894e-e001-4afe-bc52-205ff58bae34 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:39.745114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 726/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:42.009135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c931614-828e-4845-b026-9a97d061942a None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:42.009135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c931614-828e-4845-b026-9a97d061942a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:42.009135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c931614-828e-4845-b026-9a97d061942a None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:42.009135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:42.014052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdfc4c-de32-4659-8885-6f21c1d63a13 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:42.014445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdfc4c-de32-4659-8885-6f21c1d63a13 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:42.014583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdfc4c-de32-4659-8885-6f21c1d63a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:42.061383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:42.079187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3cbdfc4c-de32-4659-8885-6f21c1d63a13 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:42.080387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3cbdfc4c-de32-4659-8885-6f21c1d63a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:42.174873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:42.459325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c931614-828e-4845-b026-9a97d061942a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:42.460937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0c931614-828e-4845-b026-9a97d061942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:42.564161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c931614-828e-4845-b026-9a97d061942a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:42.603387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:42.639617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76ab43-43f0-4f5d-9191-a84bfef06999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:42.675928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ab43-43f0-4f5d-9191-a84bfef06999 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:42.675928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ab43-43f0-4f5d-9191-a84bfef06999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:42.675928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ab43-43f0-4f5d-9191-a84bfef06999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:42.675928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-db76ab43-43f0-4f5d-9191-a84bfef06999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:42.752055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76ab43-43f0-4f5d-9191-a84bfef06999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:42.753430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76ab43-43f0-4f5d-9191-a84bfef06999 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:42.771773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 722/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:44.800513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03eeb-27a7-4c57-8c3d-0e2bd049ddfe None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:44.801040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03eeb-27a7-4c57-8c3d-0e2bd049ddfe None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:44.801040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03eeb-27a7-4c57-8c3d-0e2bd049ddfe None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:44.802399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:44.807902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ad54-0221-431e-a862-b7e91fd5cd40 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:44.808325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ad54-0221-431e-a862-b7e91fd5cd40 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:44.808434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ad54-0221-431e-a862-b7e91fd5cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:44.874088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d187ad54-0221-431e-a862-b7e91fd5cd40 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:44.875345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d187ad54-0221-431e-a862-b7e91fd5cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:44.895746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:44.971594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:45.261936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03eeb-27a7-4c57-8c3d-0e2bd049ddfe None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:45.263513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5cb03eeb-27a7-4c57-8c3d-0e2bd049ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:45.365049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03eeb-27a7-4c57-8c3d-0e2bd049ddfe None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:45.386360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:45.439290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4455686-aa53-4b6a-a228-3954035ec944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:45.439909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455686-aa53-4b6a-a228-3954035ec944 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:45.440179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455686-aa53-4b6a-a228-3954035ec944 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:45.440442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455686-aa53-4b6a-a228-3954035ec944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:45.442008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b4455686-aa53-4b6a-a228-3954035ec944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:45.547685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4455686-aa53-4b6a-a228-3954035ec944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:45.549135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4455686-aa53-4b6a-a228-3954035ec944 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:45.567678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 729/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:47.528712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb72ad9-bc4a-4645-bb71-152e858a8e3b None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:47.529308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb72ad9-bc4a-4645-bb71-152e858a8e3b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:47.529308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb72ad9-bc4a-4645-bb71-152e858a8e3b None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:47.530605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:47.535782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077c920-15d3-43f3-8e64-58d268aa128e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:47.536209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077c920-15d3-43f3-8e64-58d268aa128e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:47.536440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077c920-15d3-43f3-8e64-58d268aa128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:47.600533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:47.603117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3077c920-15d3-43f3-8e64-58d268aa128e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:47.604402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3077c920-15d3-43f3-8e64-58d268aa128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:47.698861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:40:47.982370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb72ad9-bc4a-4645-bb71-152e858a8e3b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:47.983977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4fb72ad9-bc4a-4645-bb71-152e858a8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:48.087074 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb72ad9-bc4a-4645-bb71-152e858a8e3b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:48.136742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:48.160965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f240131-f191-40ed-b7d0-2e75184037b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:48.161566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f240131-f191-40ed-b7d0-2e75184037b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:48.161841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f240131-f191-40ed-b7d0-2e75184037b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:48.162109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f240131-f191-40ed-b7d0-2e75184037b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:48.163724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8f240131-f191-40ed-b7d0-2e75184037b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:48.270834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f240131-f191-40ed-b7d0-2e75184037b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:48.272343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f240131-f191-40ed-b7d0-2e75184037b7 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:48.291666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 725/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:50.239629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281e82-d5f1-4768-b663-c33fd446db1d None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:50.240196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281e82-d5f1-4768-b663-c33fd446db1d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:50.240196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281e82-d5f1-4768-b663-c33fd446db1d None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:50.241517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:50.246718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65a67-43af-4406-971d-5c01f978f768 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:50.247100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65a67-43af-4406-971d-5c01f978f768 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:50.247289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65a67-43af-4406-971d-5c01f978f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:50.311807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-33d65a67-43af-4406-971d-5c01f978f768 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:50.313005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-33d65a67-43af-4406-971d-5c01f978f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:50.342446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:50.410968 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:50.693258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281e82-d5f1-4768-b663-c33fd446db1d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:50.694804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-eb281e82-d5f1-4768-b663-c33fd446db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:50.803661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281e82-d5f1-4768-b663-c33fd446db1d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:50.831788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:50.877873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5d90-58a7-4a4b-b009-e8d12ae1a4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:50.878472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5d90-58a7-4a4b-b009-e8d12ae1a4ac service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:50.878744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5d90-58a7-4a4b-b009-e8d12ae1a4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:50.879010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5d90-58a7-4a4b-b009-e8d12ae1a4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:50.880617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-21de5d90-58a7-4a4b-b009-e8d12ae1a4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:50.987041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de5d90-58a7-4a4b-b009-e8d12ae1a4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:50.988406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de5d90-58a7-4a4b-b009-e8d12ae1a4ac service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:51.006981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 732/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:52.946531 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4899-631a-4c2e-aa2d-7203297da08a None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:52.947046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4899-631a-4c2e-aa2d-7203297da08a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:52.947046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4899-631a-4c2e-aa2d-7203297da08a None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:52.948362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:52.954359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24aaeb-fdde-44e0-b055-28c2befcc33f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:52.954793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24aaeb-fdde-44e0-b055-28c2befcc33f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:52.954888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24aaeb-fdde-44e0-b055-28c2befcc33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.025062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9f24aaeb-fdde-44e0-b055-28c2befcc33f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:53.026288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9f24aaeb-fdde-44e0-b055-28c2befcc33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:53.034400 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:53.120155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:53.405631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad4899-631a-4c2e-aa2d-7203297da08a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:53.407243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6aad4899-631a-4c2e-aa2d-7203297da08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:53.508202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad4899-631a-4c2e-aa2d-7203297da08a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:53.562064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:53.580610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b863ac-4677-4906-a47e-82a3f5e5088a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:53.581201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b863ac-4677-4906-a47e-82a3f5e5088a service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:53.581475 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b863ac-4677-4906-a47e-82a3f5e5088a service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:53.581740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b863ac-4677-4906-a47e-82a3f5e5088a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:53.583436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f8b863ac-4677-4906-a47e-82a3f5e5088a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:53.692844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b863ac-4677-4906-a47e-82a3f5e5088a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:53.694280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b863ac-4677-4906-a47e-82a3f5e5088a service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:53.712916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 728/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:55.666537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ef367-cf43-4c0f-99a0-908bf4f08d17 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:55.667009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ef367-cf43-4c0f-99a0-908bf4f08d17 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:55.667128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ef367-cf43-4c0f-99a0-908bf4f08d17 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:55.669144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:55.674454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faef7a-2dfc-44ad-9dd0-0e6752771099 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:55.674896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faef7a-2dfc-44ad-9dd0-0e6752771099 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:55.675004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faef7a-2dfc-44ad-9dd0-0e6752771099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:55.740870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-64faef7a-2dfc-44ad-9dd0-0e6752771099 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:55.742090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-64faef7a-2dfc-44ad-9dd0-0e6752771099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:55.780044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:55.835635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:56.115601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ef367-cf43-4c0f-99a0-908bf4f08d17 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:56.117196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ac7ef367-cf43-4c0f-99a0-908bf4f08d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:56.226289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ef367-cf43-4c0f-99a0-908bf4f08d17 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:56.263405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:56.298618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2f8a8-9784-4858-b125-5120b77694ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:56.299252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2f8a8-9784-4858-b125-5120b77694ff service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:56.299533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2f8a8-9784-4858-b125-5120b77694ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:56.299804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2f8a8-9784-4858-b125-5120b77694ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:56.301397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e4d2f8a8-9784-4858-b125-5120b77694ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:56.408640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2f8a8-9784-4858-b125-5120b77694ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:56.409999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2f8a8-9784-4858-b125-5120b77694ff service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:56.427638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 735/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:58.339758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc583-dbe5-4110-8510-644620d1c161 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:58.340297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc583-dbe5-4110-8510-644620d1c161 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:58.340297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc583-dbe5-4110-8510-644620d1c161 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:58.341645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:40:58.346965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291ee6-ab87-48f6-b461-7cc00bb197a7 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:58.347465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291ee6-ab87-48f6-b461-7cc00bb197a7 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:58.347564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291ee6-ab87-48f6-b461-7cc00bb197a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:58.412207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4f291ee6-ab87-48f6-b461-7cc00bb197a7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:58.413399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4f291ee6-ab87-48f6-b461-7cc00bb197a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:58.431332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:58.509267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:58.792047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc583-dbe5-4110-8510-644620d1c161 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:58.794230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-aa0dc583-dbe5-4110-8510-644620d1c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:58.897307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc583-dbe5-4110-8510-644620d1c161 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:58.963401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:58.970588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9953fd-4b6f-42f3-9133-23b1fbb63b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:58.971207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9953fd-4b6f-42f3-9133-23b1fbb63b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:58.971489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9953fd-4b6f-42f3-9133-23b1fbb63b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:58.971755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9953fd-4b6f-42f3-9133-23b1fbb63b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:58.973339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0e9953fd-4b6f-42f3-9133-23b1fbb63b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:59.082095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9953fd-4b6f-42f3-9133-23b1fbb63b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:59.083663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9953fd-4b6f-42f3-9133-23b1fbb63b9f service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:59.102550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 731/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:01.096710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428fb7-2e75-4bae-8f09-74bddfa46d8f None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:01.097284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428fb7-2e75-4bae-8f09-74bddfa46d8f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:01.097284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428fb7-2e75-4bae-8f09-74bddfa46d8f None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:01.098598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:01.103872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9da22-1b55-4392-86f1-bfce367beabc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:01.104306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9da22-1b55-4392-86f1-bfce367beabc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:01.104411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9da22-1b55-4392-86f1-bfce367beabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:01.171216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-eba9da22-1b55-4392-86f1-bfce367beabc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:01.172458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-eba9da22-1b55-4392-86f1-bfce367beabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:01.221570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:01.269358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:01.560659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428fb7-2e75-4bae-8f09-74bddfa46d8f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:01.562230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d8428fb7-2e75-4bae-8f09-74bddfa46d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:01.664805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428fb7-2e75-4bae-8f09-74bddfa46d8f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:01.711871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:01.737306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67390cd-67fb-4940-8192-9fb56445cfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:01.737906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67390cd-67fb-4940-8192-9fb56445cfae service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:01.738182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67390cd-67fb-4940-8192-9fb56445cfae service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:01.738449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67390cd-67fb-4940-8192-9fb56445cfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:01.740067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a67390cd-67fb-4940-8192-9fb56445cfae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:01.847245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67390cd-67fb-4940-8192-9fb56445cfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:01.848619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67390cd-67fb-4940-8192-9fb56445cfae service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:01.867646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 738/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:11.294939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=22 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:11.865375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=66 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:22.167675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64efb02-b7ad-48e9-b5c1-bb3917c05043 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:22.168258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64efb02-b7ad-48e9-b5c1-bb3917c05043 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:22.168258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64efb02-b7ad-48e9-b5c1-bb3917c05043 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:22.169645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 733/1471] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:41:22.174789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f604f25-dcc7-4aca-bcab-4ffbb5e50aac None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:22.175264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f604f25-dcc7-4aca-bcab-4ffbb5e50aac None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:22.175376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f604f25-dcc7-4aca-bcab-4ffbb5e50aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:22.240907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6f604f25-dcc7-4aca-bcab-4ffbb5e50aac None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:22.242138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6f604f25-dcc7-4aca-bcab-4ffbb5e50aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:22.338610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 739/1472] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:22.634228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bc66-037b-40f8-ac85-9e2fbfbee123 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:22.634509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bc66-037b-40f8-ac85-9e2fbfbee123 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:22.634778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bc66-037b-40f8-ac85-9e2fbfbee123 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:22.636166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 734/1473] 10.222.0.69 () {54 vars in 967 bytes} [Thu Sep 1 16:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:22.640946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f10ce-9a91-4482-81ac-35f64184c72b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:22.641297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f10ce-9a91-4482-81ac-35f64184c72b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:22.641570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f10ce-9a91-4482-81ac-35f64184c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:22.716343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a51f10ce-9a91-4482-81ac-35f64184c72b None None] MFA Rules not processed for user `6a2b14464bea4a81b2995c6f9289ec73`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:22.717541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a51f10ce-9a91-4482-81ac-35f64184c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:22.738562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:22.794514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 740/1474] 10.222.0.69 () {58 vars in 1064 bytes} [Thu Sep 1 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:22.802055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bc66-037b-40f8-ac85-9e2fbfbee123 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:22.803650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4916bc66-037b-40f8-ac85-9e2fbfbee123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:22.906987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bc66-037b-40f8-ac85-9e2fbfbee123 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:22.980091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecae98-ace5-4d6f-a56d-f3e151296ea7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:22.980705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecae98-ace5-4d6f-a56d-f3e151296ea7 service glance] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:22.980978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecae98-ace5-4d6f-a56d-f3e151296ea7 service glance] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:22.981242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecae98-ace5-4d6f-a56d-f3e151296ea7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:22.982809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-15ecae98-ace5-4d6f-a56d-f3e151296ea7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:23.035571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:23.090598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecae98-ace5-4d6f-a56d-f3e151296ea7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:23.092061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecae98-ace5-4d6f-a56d-f3e151296ea7 service glance] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:23.110643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 735/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:25.097984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557b6c-cd7a-43c6-aa21-a52566ba2171 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:25.098547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557b6c-cd7a-43c6-aa21-a52566ba2171 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:25.098547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82557b6c-cd7a-43c6-aa21-a52566ba2171 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:25.099931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 741/1476] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:25.105231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892a55-e7cc-4cb7-8ff6-2e7cabcaa97e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:25.105760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892a55-e7cc-4cb7-8ff6-2e7cabcaa97e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:25.105760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892a55-e7cc-4cb7-8ff6-2e7cabcaa97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:25.171792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ee892a55-e7cc-4cb7-8ff6-2e7cabcaa97e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:25.172999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ee892a55-e7cc-4cb7-8ff6-2e7cabcaa97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:25.269588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 736/1477] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:25.542151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82557b6c-cd7a-43c6-aa21-a52566ba2171 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:25.545495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-82557b6c-cd7a-43c6-aa21-a52566ba2171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:25.671076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82557b6c-cd7a-43c6-aa21-a52566ba2171 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:25.720473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:25.765318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb45dd-a99a-4fd6-98e0-e5d5eaa82a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:25.765945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb45dd-a99a-4fd6-98e0-e5d5eaa82a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:25.766215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb45dd-a99a-4fd6-98e0-e5d5eaa82a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:25.766476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb45dd-a99a-4fd6-98e0-e5d5eaa82a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:25.767101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb45dd-a99a-4fd6-98e0-e5d5eaa82a19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:25.768831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-71eb45dd-a99a-4fd6-98e0-e5d5eaa82a19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:41:25.768831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:41:25.768831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:41:25.769962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb45dd-a99a-4fd6-98e0-e5d5eaa82a19 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:25.788737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 742/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 1 16:41:25 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:27.730521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea878d6-5bd4-4dc2-8ecf-bb76ac28aab7 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:27.731035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea878d6-5bd4-4dc2-8ecf-bb76ac28aab7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:27.731035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea878d6-5bd4-4dc2-8ecf-bb76ac28aab7 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:27.732460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 737/1479] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:27.737923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298fdf-869f-4668-84c2-64dab1473499 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:27.738319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298fdf-869f-4668-84c2-64dab1473499 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:27.738497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298fdf-869f-4668-84c2-64dab1473499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:27.805109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-51298fdf-869f-4668-84c2-64dab1473499 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:27.806325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-51298fdf-869f-4668-84c2-64dab1473499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:27.901462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 743/1480] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:28.191945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea878d6-5bd4-4dc2-8ecf-bb76ac28aab7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:28.193483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6ea878d6-5bd4-4dc2-8ecf-bb76ac28aab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:28.203710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:28.337646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea878d6-5bd4-4dc2-8ecf-bb76ac28aab7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:28.415810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:28.448350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e530b83-6a2f-4c0e-a8a1-491f4f53a2ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:28.448883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530b83-6a2f-4c0e-a8a1-491f4f53a2ca service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:28.449163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530b83-6a2f-4c0e-a8a1-491f4f53a2ca service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:28.449436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530b83-6a2f-4c0e-a8a1-491f4f53a2ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:28.451167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8e530b83-6a2f-4c0e-a8a1-491f4f53a2ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:28.539421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e530b83-6a2f-4c0e-a8a1-491f4f53a2ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:28.541524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e530b83-6a2f-4c0e-a8a1-491f4f53a2ca service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:28.561822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 738/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:30.664364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda396a-f098-459a-a9f0-02e6b0094a00 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:30.664871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda396a-f098-459a-a9f0-02e6b0094a00 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:30.664979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda396a-f098-459a-a9f0-02e6b0094a00 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:30.666813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 744/1482] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:30.672079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbef6-bca6-464c-afd7-453d15c81aec None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:30.672512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbef6-bca6-464c-afd7-453d15c81aec None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:30.672615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbef6-bca6-464c-afd7-453d15c81aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:30.737916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a97cbef6-bca6-464c-afd7-453d15c81aec None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:30.739145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a97cbef6-bca6-464c-afd7-453d15c81aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:30.784937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:30.836478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 739/1483] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:31.130166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda396a-f098-459a-a9f0-02e6b0094a00 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:31.131769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2eda396a-f098-459a-a9f0-02e6b0094a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:31.155867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:31.235082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda396a-f098-459a-a9f0-02e6b0094a00 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:31.309282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb672-8e24-4a9b-a11f-0bea31cb4510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:31.309875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb672-8e24-4a9b-a11f-0bea31cb4510 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:31.310178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb672-8e24-4a9b-a11f-0bea31cb4510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:31.311101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb672-8e24-4a9b-a11f-0bea31cb4510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:31.312727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-568cb672-8e24-4a9b-a11f-0bea31cb4510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:31.390169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:31.423772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cb672-8e24-4a9b-a11f-0bea31cb4510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:31.425193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cb672-8e24-4a9b-a11f-0bea31cb4510 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:31.443868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 745/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:33.405811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7340f-d017-4487-9dca-9800957f0aa4 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:33.406329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7340f-d017-4487-9dca-9800957f0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:33.406329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7340f-d017-4487-9dca-9800957f0aa4 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:33.407695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 740/1485] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:33.412920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273e719-2518-4c65-a755-4c3147234883 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:33.413341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273e719-2518-4c65-a755-4c3147234883 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:33.413446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273e719-2518-4c65-a755-4c3147234883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:33.478125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6273e719-2518-4c65-a755-4c3147234883 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:33.479849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6273e719-2518-4c65-a755-4c3147234883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:33.576115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 746/1486] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:33.871877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7340f-d017-4487-9dca-9800957f0aa4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:33.873426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-58a7340f-d017-4487-9dca-9800957f0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:34.108494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7340f-d017-4487-9dca-9800957f0aa4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:34.178441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:34.180134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844f3a1-fc44-4c7d-8b5a-a994afeec05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:34.180730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f3a1-fc44-4c7d-8b5a-a994afeec05c service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:34.181004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f3a1-fc44-4c7d-8b5a-a994afeec05c service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:34.181801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f3a1-fc44-4c7d-8b5a-a994afeec05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:34.183434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e844f3a1-fc44-4c7d-8b5a-a994afeec05c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:34.293150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844f3a1-fc44-4c7d-8b5a-a994afeec05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:34.295067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844f3a1-fc44-4c7d-8b5a-a994afeec05c service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:34.316009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 741/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:36.322842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffcaa4-1243-4047-8fe9-c4ac5e6cda33 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:36.323457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffcaa4-1243-4047-8fe9-c4ac5e6cda33 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:36.323647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffcaa4-1243-4047-8fe9-c4ac5e6cda33 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:36.326164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 747/1488] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:36.331951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb931-73b2-4ae7-bbcb-f507e871479e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:36.332392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb931-73b2-4ae7-bbcb-f507e871479e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:36.332503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb931-73b2-4ae7-bbcb-f507e871479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:36.399766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-47eeb931-73b2-4ae7-bbcb-f507e871479e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:36.401000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-47eeb931-73b2-4ae7-bbcb-f507e871479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:36.453646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:36.497585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 742/1489] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:36.796207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffcaa4-1243-4047-8fe9-c4ac5e6cda33 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:36.797747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-53ffcaa4-1243-4047-8fe9-c4ac5e6cda33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:36.833422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:36.901959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffcaa4-1243-4047-8fe9-c4ac5e6cda33 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:36.973382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57f58-bfcd-470a-a260-4f05d0abd948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:36.973986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57f58-bfcd-470a-a260-4f05d0abd948 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:36.974264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57f58-bfcd-470a-a260-4f05d0abd948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:36.974536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57f58-bfcd-470a-a260-4f05d0abd948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:36.976155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-47b57f58-bfcd-470a-a260-4f05d0abd948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:37.058822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:37.089216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b57f58-bfcd-470a-a260-4f05d0abd948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:37.091123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b57f58-bfcd-470a-a260-4f05d0abd948 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:37.109112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 748/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:39.429019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489646-f4da-4cfc-a815-b3d6e97d02d2 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:39.429584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489646-f4da-4cfc-a815-b3d6e97d02d2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:39.429584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489646-f4da-4cfc-a815-b3d6e97d02d2 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:39.430901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 743/1491] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 1 16:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:39.436788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ed2b-5da5-4021-bf1d-dcc41f6e52d3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:39.437216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ed2b-5da5-4021-bf1d-dcc41f6e52d3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:39.437320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ed2b-5da5-4021-bf1d-dcc41f6e52d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:39.503088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-28d5ed2b-5da5-4021-bf1d-dcc41f6e52d3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:39.504320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-28d5ed2b-5da5-4021-bf1d-dcc41f6e52d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:39.598570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 749/1492] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 1 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:39.887392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489646-f4da-4cfc-a815-b3d6e97d02d2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:39.888941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-43489646-f4da-4cfc-a815-b3d6e97d02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:39.991231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489646-f4da-4cfc-a815-b3d6e97d02d2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:40.063281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21227105-5eec-4339-8144-b697ad8a9348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:40.063881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227105-5eec-4339-8144-b697ad8a9348 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:40.064157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227105-5eec-4339-8144-b697ad8a9348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:40.064425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227105-5eec-4339-8144-b697ad8a9348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:40.066002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-21227105-5eec-4339-8144-b697ad8a9348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:40.075761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:40.174559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227105-5eec-4339-8144-b697ad8a9348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:40.175964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227105-5eec-4339-8144-b697ad8a9348 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:40.194329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 744/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:49.596756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=82 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:50.191907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=50 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:16.499382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.499981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.499981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.577981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:16.579259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.680571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 750/1494] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:16.689303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bc641-9c38-40ca-afd8-8322cbc300cc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.689795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bc641-9c38-40ca-afd8-8322cbc300cc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.689917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bc641-9c38-40ca-afd8-8322cbc300cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.766507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-966bc641-9c38-40ca-afd8-8322cbc300cc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:16.767797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-966bc641-9c38-40ca-afd8-8322cbc300cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.862119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 745/1495] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:16.866844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.868134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.880103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5273c-5e80-4c5f-b4a2-4d975481a999 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.941343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:16.974117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.974720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.975003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.975302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.975943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:16.976329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.977333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:16.977333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:43:16.977333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:43:16.978217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.990232 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 751/1496] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:16.999569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bc641-9c38-40ca-afd8-8322cbc300cc None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.008545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bc641-9c38-40ca-afd8-8322cbc300cc None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.069634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:17.102889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.103443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.103907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.104457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.105069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.107324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING py.warnings [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:17.107324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: warnings.warn(msg) Sep 01 16:43:17.107324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: Sep 01 16:43:17.108509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.229283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 746/1497] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:17.233706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.235323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:17.269589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2683a1-cfc5-4875-b48d-dff985be999f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.361008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.361532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.361807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.362074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.362700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.363731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:17.363731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:43:17.363731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:43:17.364944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.480646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 752/1498] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:17 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:17.484924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.486489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:17.546720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c865c-456d-412d-b2a7-148378a7746c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.627554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:17.638820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.639507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.639783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.640051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.640715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.641717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING py.warnings [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:17.641717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: warnings.warn(msg) Sep 01 16:43:17.641717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: Sep 01 16:43:17.642606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.658731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 747/1499] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:17.662821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.664368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:17.676401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3af565-f4e9-44dc-ace7-68becf2b223f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.701539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:17.772126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebfd59-a723-4da6-b6a6-bcf92e83944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.776922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebfd59-a723-4da6-b6a6-bcf92e83944e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.776922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebfd59-a723-4da6-b6a6-bcf92e83944e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.776922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebfd59-a723-4da6-b6a6-bcf92e83944e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.776922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebfd59-a723-4da6-b6a6-bcf92e83944e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.776922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-b9ebfd59-a723-4da6-b6a6-bcf92e83944e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:17.776922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:43:17.776922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:43:17.777555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebfd59-a723-4da6-b6a6-bcf92e83944e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.788169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 753/1500] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:17.792446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.794627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:17.827962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd66a2-eb64-4f9e-b4a1-eba5d7d83b72 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.921108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0218aaf-f81c-48b4-9bb5-7f59e25eedf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.921707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218aaf-f81c-48b4-9bb5-7f59e25eedf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.921969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218aaf-f81c-48b4-9bb5-7f59e25eedf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.922240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218aaf-f81c-48b4-9bb5-7f59e25eedf5 admin admin] PATH_INFO: `/v3/projects/038553e95a6b40939fa8513c4bbee99c/users/063e3360754f44cba88382d8a21d3b2d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.944414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0218aaf-f81c-48b4-9bb5-7f59e25eedf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038553e95a6b40939fa8513c4bbee99c, user_id=063e3360754f44cba88382d8a21d3b2d, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.945430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING py.warnings [None req-b0218aaf-f81c-48b4-9bb5-7f59e25eedf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:17.945430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: warnings.warn(msg) Sep 01 16:43:17.945430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: Sep 01 16:43:17.947551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0218aaf-f81c-48b4-9bb5-7f59e25eedf5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.039223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 748/1501] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:17 2022] PUT /identity/v3/projects/038553e95a6b40939fa8513c4bbee99c/users/063e3360754f44cba88382d8a21d3b2d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:18.051826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65db22-0e30-4959-a5b7-3b47a18cbaab None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.052115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65db22-0e30-4959-a5b7-3b47a18cbaab None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.052391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65db22-0e30-4959-a5b7-3b47a18cbaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.109349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-bb65db22-0e30-4959-a5b7-3b47a18cbaab None None] MFA Rules not processed for user `063e3360754f44cba88382d8a21d3b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:18.114251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bb65db22-0e30-4959-a5b7-3b47a18cbaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.187214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 754/1502] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:18.200730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598a8-6975-4d68-9022-62b8ad045f0f None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.201013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598a8-6975-4d68-9022-62b8ad045f0f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.201287 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598a8-6975-4d68-9022-62b8ad045f0f None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.202619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 749/1503] 10.222.0.69 () {54 vars in 964 bytes} [Thu Sep 1 16:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:43:18.207376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474cf0e-a5b1-4058-a065-3ce71c10cecd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.207664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474cf0e-a5b1-4058-a065-3ce71c10cecd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.207938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474cf0e-a5b1-4058-a065-3ce71c10cecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.239267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.284250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f474cf0e-a5b1-4058-a065-3ce71c10cecd None None] MFA Rules not processed for user `f5a7af0d09114d14a22cdb8291fe8b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:18.285453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f474cf0e-a5b1-4058-a065-3ce71c10cecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.361694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 755/1504] 10.222.0.69 () {58 vars in 1061 bytes} [Thu Sep 1 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:18.371103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6598a8-6975-4d68-9022-62b8ad045f0f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.373177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9c6598a8-6975-4d68-9022-62b8ad045f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.422583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.474652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6598a8-6975-4d68-9022-62b8ad045f0f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.547300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.547894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.548164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.548427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.549996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.646879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.648613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.652190 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.666506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 750/1505] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:18.711792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3945f-77f6-4de7-b765-edadc568e9ff None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.712247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3945f-77f6-4de7-b765-edadc568e9ff None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.712350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3945f-77f6-4de7-b765-edadc568e9ff None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.713597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 756/1506] 10.222.0.69 () {52 vars in 830 bytes} [Thu Sep 1 16:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:43:18.717172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.718376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.815118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a90d-34dc-4655-a5be-f22666643412 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.905251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.905862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.906131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.906394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] PATH_INFO: `/v3/users/063e3360754f44cba88382d8a21d3b2d` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.918025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063e3360754f44cba88382d8a21d3b2d)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.919064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING py.warnings [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:18.919064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: warnings.warn(msg) Sep 01 16:43:18.919064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: Sep 01 16:43:18.920829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.930174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:19.162538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063e3360754f44cba88382d8a21d3b2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.185983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063e3360754f44cba88382d8a21d3b2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.199447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063e3360754f44cba88382d8a21d3b2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.200020 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063e3360754f44cba88382d8a21d3b2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.200446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063e3360754f44cba88382d8a21d3b2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:19.284518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 751/1507] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:18 2022] DELETE /identity/v3/users/063e3360754f44cba88382d8a21d3b2d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:19.288844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.296796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.296796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.345954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:19.347177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.421941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:19.434095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 757/1508] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:19.445362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.446620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.546624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3409-8973-4ff5-a0b9-37a7ae829da9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.599389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:19.618408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affb66e-4de3-4e2d-a7eb-c7139951abd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.619005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb66e-4de3-4e2d-a7eb-c7139951abd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.619314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb66e-4de3-4e2d-a7eb-c7139951abd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.619590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb66e-4de3-4e2d-a7eb-c7139951abd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.621172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4affb66e-4de3-4e2d-a7eb-c7139951abd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.727642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affb66e-4de3-4e2d-a7eb-c7139951abd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.729021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affb66e-4de3-4e2d-a7eb-c7139951abd0 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.747448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 752/1509] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:20.240429 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.241748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:20.253797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c8d4a-2b11-4f5e-9638-cdea1c38dc25 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.351614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.352267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.352546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.352817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] PATH_INFO: `/v3/projects/038553e95a6b40939fa8513c4bbee99c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.363103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038553e95a6b40939fa8513c4bbee99c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.364148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:43:20.364148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:43:20.364148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:43:20.365620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.506996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038553e95a6b40939fa8513c4bbee99c', 'request_id': 'req-11e0d1c3-e491-4f76-b9f0-f7722369c958'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.513050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038553e95a6b40939fa8513c4bbee99c', 'request_id': 'req-11e0d1c3-e491-4f76-b9f0-f7722369c958'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.586878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038553e95a6b40939fa8513c4bbee99c', 'request_id': 'req-11e0d1c3-e491-4f76-b9f0-f7722369c958'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.618806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] The token cache is being invalidate because project 038553e95a6b40939fa8513c4bbee99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:20.619091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.619657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-11e0d1c3-e491-4f76-b9f0-f7722369c958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.620951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 758/1510] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:20 2022] DELETE /identity/v3/projects/038553e95a6b40939fa8513c4bbee99c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:29.745257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=62 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:30.616934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:02.459600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184002e7-aad9-4cb4-8773-77f31eda4763 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:02.460259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184002e7-aad9-4cb4-8773-77f31eda4763 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:02.460259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184002e7-aad9-4cb4-8773-77f31eda4763 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:02.461447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:02.466178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3aef8-23fa-4e52-96d1-9edf47e50842 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:02.466614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3aef8-23fa-4e52-96d1-9edf47e50842 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:02.466723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3aef8-23fa-4e52-96d1-9edf47e50842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:02.546082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-80b3aef8-23fa-4e52-96d1-9edf47e50842 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:02.547318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-80b3aef8-23fa-4e52-96d1-9edf47e50842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:02.652128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:02.802419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184002e7-aad9-4cb4-8773-77f31eda4763 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:02.804549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-184002e7-aad9-4cb4-8773-77f31eda4763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:02.923689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184002e7-aad9-4cb4-8773-77f31eda4763 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:02.929170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9d9e7-9a82-4eaf-8003-c25de617d864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:02.929765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9d9e7-9a82-4eaf-8003-c25de617d864 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:02.930043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9d9e7-9a82-4eaf-8003-c25de617d864 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:02.930315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9d9e7-9a82-4eaf-8003-c25de617d864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:02.938878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9d9e7-9a82-4eaf-8003-c25de617d864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:02.940501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9d9e7-9a82-4eaf-8003-c25de617d864 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:02.949693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 754/1513] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:03.781471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30acc-3b2d-4376-b210-53d9f20289d2 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:03.782549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30acc-3b2d-4376-b210-53d9f20289d2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:03.782549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30acc-3b2d-4376-b210-53d9f20289d2 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:03.783937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:03.788772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead538a-c867-474a-af63-a03207db695f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:03.789203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead538a-c867-474a-af63-a03207db695f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:03.789354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead538a-c867-474a-af63-a03207db695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:03.809318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2ead538a-c867-474a-af63-a03207db695f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:03.810528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2ead538a-c867-474a-af63-a03207db695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:03.818387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:03.972631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f30acc-3b2d-4376-b210-53d9f20289d2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:03.987872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f30acc-3b2d-4376-b210-53d9f20289d2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:03.993399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a87c69-e769-4904-a06f-d65a860cf934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:03.993991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87c69-e769-4904-a06f-d65a860cf934 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:03.994292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87c69-e769-4904-a06f-d65a860cf934 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:03.994564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87c69-e769-4904-a06f-d65a860cf934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:04.003256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a87c69-e769-4904-a06f-d65a860cf934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:04.005116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a87c69-e769-4904-a06f-d65a860cf934 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:04.014487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 761/1516] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:04.484887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309689-a6bc-42a9-b0b0-7a09eb470cbd None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:04.485789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309689-a6bc-42a9-b0b0-7a09eb470cbd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:04.486057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309689-a6bc-42a9-b0b0-7a09eb470cbd None None] PATH_INFO: `/v3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:04.487364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 756/1517] 10.222.0.43 () {54 vars in 925 bytes} [Thu Sep 1 16:45:04 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:45:04.495133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e99f-c661-425b-924a-c9ab0535c2f2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:04.495445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e99f-c661-425b-924a-c9ab0535c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:04.495720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e99f-c661-425b-924a-c9ab0535c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:04.554251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-28f9e99f-c661-425b-924a-c9ab0535c2f2 None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:04.555495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-28f9e99f-c661-425b-924a-c9ab0535c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:04.571720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:04.624505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 762/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 1 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:13.804300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=56 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:14.621700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=23 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:14.731486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35736-daac-49c9-aad1-c69bad9dc85b None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:14.731788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35736-daac-49c9-aad1-c69bad9dc85b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:14.732127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35736-daac-49c9-aad1-c69bad9dc85b None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:14.733665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 757/1519] 10.222.0.69 () {54 vars in 961 bytes} [Thu Sep 1 16:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:14.738955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753a625-a676-484e-9f0a-f503ff6f3fbc None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:14.741479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753a625-a676-484e-9f0a-f503ff6f3fbc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:14.741849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753a625-a676-484e-9f0a-f503ff6f3fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:14.764889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5753a625-a676-484e-9f0a-f503ff6f3fbc None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:14.766959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5753a625-a676-484e-9f0a-f503ff6f3fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:14.777469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 763/1520] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Sep 1 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:14.786580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35736-daac-49c9-aad1-c69bad9dc85b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:14.799961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35736-daac-49c9-aad1-c69bad9dc85b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:14.804867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96175ef1-6604-43fb-aa95-565d6255040f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:14.805458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96175ef1-6604-43fb-aa95-565d6255040f service placement] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:14.805716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96175ef1-6604-43fb-aa95-565d6255040f service placement] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:14.805988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96175ef1-6604-43fb-aa95-565d6255040f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:14.816032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96175ef1-6604-43fb-aa95-565d6255040f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:14.817624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96175ef1-6604-43fb-aa95-565d6255040f service placement] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:14.827649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 758/1521] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:45:15.261786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ac1d-8980-48dc-b672-c3b86c8e410f None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:15.262074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ac1d-8980-48dc-b672-c3b86c8e410f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:15.262452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ac1d-8980-48dc-b672-c3b86c8e410f None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:15.263900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:15.268785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297ca8c-68aa-40e1-b4c0-42a09f437a3d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:15.275879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297ca8c-68aa-40e1-b4c0-42a09f437a3d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:15.275879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297ca8c-68aa-40e1-b4c0-42a09f437a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:15.288551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0297ca8c-68aa-40e1-b4c0-42a09f437a3d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:15.289757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0297ca8c-68aa-40e1-b4c0-42a09f437a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:15.298209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:15.451572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ac1d-8980-48dc-b672-c3b86c8e410f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:15.466811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ac1d-8980-48dc-b672-c3b86c8e410f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:15.473919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e2dae-249b-4bc2-af1b-f163119ab83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:15.474524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e2dae-249b-4bc2-af1b-f163119ab83e service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:15.474828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e2dae-249b-4bc2-af1b-f163119ab83e service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:15.475066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e2dae-249b-4bc2-af1b-f163119ab83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:15.484022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e2dae-249b-4bc2-af1b-f163119ab83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:15.485667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e2dae-249b-4bc2-af1b-f163119ab83e service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:15.495873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 765/1524] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:16.311884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3fa3-fb57-43ee-998e-96ccec39e6e8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:16.312496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3fa3-fb57-43ee-998e-96ccec39e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:16.313132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a3fa3-fb57-43ee-998e-96ccec39e6e8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:16.314452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:16.319136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d401-8b40-4e3e-8215-a52df64396dd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:16.319573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d401-8b40-4e3e-8215-a52df64396dd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:16.319711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d401-8b40-4e3e-8215-a52df64396dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:16.338753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1f13d401-8b40-4e3e-8215-a52df64396dd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:16.339984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1f13d401-8b40-4e3e-8215-a52df64396dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:16.348230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:16.500811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3fa3-fb57-43ee-998e-96ccec39e6e8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:16.519039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a3fa3-fb57-43ee-998e-96ccec39e6e8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:16.524562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73babd4-f907-4333-833b-8ab3f9e0e293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:16.525154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73babd4-f907-4333-833b-8ab3f9e0e293 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:16.525434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73babd4-f907-4333-833b-8ab3f9e0e293 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:16.525709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73babd4-f907-4333-833b-8ab3f9e0e293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:16.534746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73babd4-f907-4333-833b-8ab3f9e0e293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:16.536414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73babd4-f907-4333-833b-8ab3f9e0e293 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:16.545822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 761/1527] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:20.649571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183901a5-6d54-48d8-90f1-4f57f48d60be None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:20.650133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183901a5-6d54-48d8-90f1-4f57f48d60be None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:20.650133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183901a5-6d54-48d8-90f1-4f57f48d60be None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:20.651735 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:20.657608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187cd14-2878-4840-9b86-91d81a460a38 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:20.658048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187cd14-2878-4840-9b86-91d81a460a38 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:20.658176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187cd14-2878-4840-9b86-91d81a460a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:20.678137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c187cd14-2878-4840-9b86-91d81a460a38 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:20.681444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c187cd14-2878-4840-9b86-91d81a460a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:20.688030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:45:21.000039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183901a5-6d54-48d8-90f1-4f57f48d60be None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:21.001666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-183901a5-6d54-48d8-90f1-4f57f48d60be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:21.082468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183901a5-6d54-48d8-90f1-4f57f48d60be None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:21.086180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867172b-56af-4149-a363-b01a4ae33f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:21.086778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867172b-56af-4149-a363-b01a4ae33f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:21.087053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867172b-56af-4149-a363-b01a4ae33f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:21.087356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867172b-56af-4149-a363-b01a4ae33f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:21.096938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867172b-56af-4149-a363-b01a4ae33f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:21.103718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867172b-56af-4149-a363-b01a4ae33f58 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:21.107833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 768/1530] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:23.029392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a64e-e8e9-4bfa-9f9b-fba206ac1c4c None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:23.029923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a64e-e8e9-4bfa-9f9b-fba206ac1c4c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:23.029923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a64e-e8e9-4bfa-9f9b-fba206ac1c4c None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:23.031396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:23.036554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3075a-8bb0-44ae-a5da-db10f9fa07a3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:23.036950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3075a-8bb0-44ae-a5da-db10f9fa07a3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:23.037094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3075a-8bb0-44ae-a5da-db10f9fa07a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:23.056397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-bfc3075a-8bb0-44ae-a5da-db10f9fa07a3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:23.057590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bfc3075a-8bb0-44ae-a5da-db10f9fa07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:23.065800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:23.353894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a64e-e8e9-4bfa-9f9b-fba206ac1c4c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:23.365390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a64e-e8e9-4bfa-9f9b-fba206ac1c4c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:23.368923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdc5f1-5c57-4794-b95c-14c0f22e825a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:23.369517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc5f1-5c57-4794-b95c-14c0f22e825a service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:23.369790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc5f1-5c57-4794-b95c-14c0f22e825a service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:23.370056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc5f1-5c57-4794-b95c-14c0f22e825a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:23.378763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdc5f1-5c57-4794-b95c-14c0f22e825a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:23.380466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdc5f1-5c57-4794-b95c-14c0f22e825a service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:23.389635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 764/1533] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:26.989998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7849-24e4-4196-8c7e-a4ffb3041484 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:26.990554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7849-24e4-4196-8c7e-a4ffb3041484 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:26.990554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7849-24e4-4196-8c7e-a4ffb3041484 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:26.991901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:26.997043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd481d-d201-48f6-99f6-3cca52960af0 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:26.997453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd481d-d201-48f6-99f6-3cca52960af0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:26.997597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd481d-d201-48f6-99f6-3cca52960af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:27.017655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c2cd481d-d201-48f6-99f6-3cca52960af0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:27.018854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c2cd481d-d201-48f6-99f6-3cca52960af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:27.026665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:27.581834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7849-24e4-4196-8c7e-a4ffb3041484 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:27.586569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6bdb7849-24e4-4196-8c7e-a4ffb3041484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:27.673596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7849-24e4-4196-8c7e-a4ffb3041484 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:27.677200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295233dd-2346-43ef-b086-8d7d45611ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:27.677803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295233dd-2346-43ef-b086-8d7d45611ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:27.678083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295233dd-2346-43ef-b086-8d7d45611ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:27.678356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295233dd-2346-43ef-b086-8d7d45611ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:27.687026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295233dd-2346-43ef-b086-8d7d45611ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:27.688504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295233dd-2346-43ef-b086-8d7d45611ff7 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:27.697767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 771/1536] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:29.632763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29398-5047-4769-b143-897b57038b82 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:29.633331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29398-5047-4769-b143-897b57038b82 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:29.633331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29398-5047-4769-b143-897b57038b82 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:29.634681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:45:29.640024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c4a28-f253-4f9e-91a4-f6509338c317 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:29.640431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c4a28-f253-4f9e-91a4-f6509338c317 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:29.640544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c4a28-f253-4f9e-91a4-f6509338c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:29.660581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-566c4a28-f253-4f9e-91a4-f6509338c317 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:29.661800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-566c4a28-f253-4f9e-91a4-f6509338c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:29.669583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:30.222418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29398-5047-4769-b143-897b57038b82 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:30.224120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c4c29398-5047-4769-b143-897b57038b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:30.237301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29398-5047-4769-b143-897b57038b82 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:30.240829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4530a5-89fc-4bb5-9fb5-f8eab1e7c589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:30.241412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4530a5-89fc-4bb5-9fb5-f8eab1e7c589 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:30.241691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4530a5-89fc-4bb5-9fb5-f8eab1e7c589 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:30.241959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4530a5-89fc-4bb5-9fb5-f8eab1e7c589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:30.250749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4530a5-89fc-4bb5-9fb5-f8eab1e7c589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:30.252189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4530a5-89fc-4bb5-9fb5-f8eab1e7c589 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:30.261654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 767/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:39.655848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=88 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:40.257579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=33 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:09.494778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb631-2352-49ca-b384-728f30dbed79 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.495989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb631-2352-49ca-b384-728f30dbed79 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.496493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb631-2352-49ca-b384-728f30dbed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.524380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d48cb631-2352-49ca-b384-728f30dbed79 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:09.526046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d48cb631-2352-49ca-b384-728f30dbed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:09.540922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 773/1540] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:09.550040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045233f6-9b20-444e-87c9-0a6440552efd None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.550592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045233f6-9b20-444e-87c9-0a6440552efd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.550592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045233f6-9b20-444e-87c9-0a6440552efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.585638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-045233f6-9b20-444e-87c9-0a6440552efd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:09.587326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-045233f6-9b20-444e-87c9-0a6440552efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:09.597365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 768/1541] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:09.602105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb631-2352-49ca-b384-728f30dbed79 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:09.623127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb631-2352-49ca-b384-728f30dbed79 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:09.632309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c088-84e3-4123-8e86-ee6bc51119ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:09.633323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c088-84e3-4123-8e86-ee6bc51119ca admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.633822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c088-84e3-4123-8e86-ee6bc51119ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.634310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c088-84e3-4123-8e86-ee6bc51119ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.635215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654c088-84e3-4123-8e86-ee6bc51119ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:09.635751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654c088-84e3-4123-8e86-ee6bc51119ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:09.637588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654c088-84e3-4123-8e86-ee6bc51119ca admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:09.666147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 774/1542] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:09.675550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045233f6-9b20-444e-87c9-0a6440552efd None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:09.696399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045233f6-9b20-444e-87c9-0a6440552efd None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:09.703191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa571b-0235-4c82-bde4-a6f012ee942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:09.703867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa571b-0235-4c82-bde4-a6f012ee942e admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.704151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa571b-0235-4c82-bde4-a6f012ee942e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.704425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa571b-0235-4c82-bde4-a6f012ee942e admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.705085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa571b-0235-4c82-bde4-a6f012ee942e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:09.707065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa571b-0235-4c82-bde4-a6f012ee942e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:09.730008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224883e9-f5a7-4778-b9b7-4d7ac570bf1f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.730362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224883e9-f5a7-4778-b9b7-4d7ac570bf1f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.730560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224883e9-f5a7-4778-b9b7-4d7ac570bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.775910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-224883e9-f5a7-4778-b9b7-4d7ac570bf1f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:09.777163 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-224883e9-f5a7-4778-b9b7-4d7ac570bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:09.791605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 775/1543] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:09.801714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3445-1ff8-47d3-b6ae-dd33d93da18f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.802072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3445-1ff8-47d3-b6ae-dd33d93da18f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.802257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3445-1ff8-47d3-b6ae-dd33d93da18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.836456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-788e3445-1ff8-47d3-b6ae-dd33d93da18f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:09.837688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-788e3445-1ff8-47d3-b6ae-dd33d93da18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:09.847933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 776/1544] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:09.854124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3445-1ff8-47d3-b6ae-dd33d93da18f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:09.865839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3445-1ff8-47d3-b6ae-dd33d93da18f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:09.876007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0335d70-7ed6-4bb5-b6f3-6635104b9230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:09.877182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335d70-7ed6-4bb5-b6f3-6635104b9230 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.877717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335d70-7ed6-4bb5-b6f3-6635104b9230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.878037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335d70-7ed6-4bb5-b6f3-6635104b9230 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.878714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0335d70-7ed6-4bb5-b6f3-6635104b9230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:09.879015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0335d70-7ed6-4bb5-b6f3-6635104b9230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:09.880785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0335d70-7ed6-4bb5-b6f3-6635104b9230 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:09.899720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 777/1545] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:47:09.904788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634638b-9eb9-4db0-bff5-b90e05bc8b7d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.904788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634638b-9eb9-4db0-bff5-b90e05bc8b7d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.904788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634638b-9eb9-4db0-bff5-b90e05bc8b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.909768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 769/1546] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:09 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:09.911027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc660e-2b35-4c25-8713-0b71c2410a5d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:09.911340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc660e-2b35-4c25-8713-0b71c2410a5d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:09.911614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc660e-2b35-4c25-8713-0b71c2410a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:09.936290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f634638b-9eb9-4db0-bff5-b90e05bc8b7d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:09.937807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f634638b-9eb9-4db0-bff5-b90e05bc8b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:09.960978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-64bc660e-2b35-4c25-8713-0b71c2410a5d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:09.962820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-64bc660e-2b35-4c25-8713-0b71c2410a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.044131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 770/1547] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.045048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc660e-2b35-4c25-8713-0b71c2410a5d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.056228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc660e-2b35-4c25-8713-0b71c2410a5d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.057003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 778/1548] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.058096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634638b-9eb9-4db0-bff5-b90e05bc8b7d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.062970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359b8a-f0e9-434d-ba63-981208e518c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.063848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359b8a-f0e9-434d-ba63-981208e518c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.064136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359b8a-f0e9-434d-ba63-981208e518c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.064406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359b8a-f0e9-434d-ba63-981208e518c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.065036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359b8a-f0e9-434d-ba63-981208e518c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.067134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359b8a-f0e9-434d-ba63-981208e518c5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.069489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634638b-9eb9-4db0-bff5-b90e05bc8b7d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.075367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19e1c2-062f-4862-9dbb-1b3b916104a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.076474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e1c2-062f-4862-9dbb-1b3b916104a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.076975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e1c2-062f-4862-9dbb-1b3b916104a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.077457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e1c2-062f-4862-9dbb-1b3b916104a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.078366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19e1c2-062f-4862-9dbb-1b3b916104a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.080574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19e1c2-062f-4862-9dbb-1b3b916104a1 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.170506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 771/1549] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:10.172762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032ad5-8bbf-4f77-8a5a-a06ce7ce3306 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.173137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032ad5-8bbf-4f77-8a5a-a06ce7ce3306 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.173491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032ad5-8bbf-4f77-8a5a-a06ce7ce3306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.193389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-db032ad5-8bbf-4f77-8a5a-a06ce7ce3306 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.194602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-db032ad5-8bbf-4f77-8a5a-a06ce7ce3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.204325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 779/1550] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:10.204697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5ed0-b628-4ab0-89fb-6bf32f7fab3d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.205052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5ed0-b628-4ab0-89fb-6bf32f7fab3d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.205440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5ed0-b628-4ab0-89fb-6bf32f7fab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.227215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3c9e5ed0-b628-4ab0-89fb-6bf32f7fab3d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.228432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3c9e5ed0-b628-4ab0-89fb-6bf32f7fab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.262291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 772/1551] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.263913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e2df-b33b-46ab-b8ab-beee41a57dd6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.264269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e2df-b33b-46ab-b8ab-beee41a57dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.264581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e2df-b33b-46ab-b8ab-beee41a57dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.287849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9666e2df-b33b-46ab-b8ab-beee41a57dd6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.289398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9666e2df-b33b-46ab-b8ab-beee41a57dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.293389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 780/1552] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.294689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad504aa-d668-4533-aaa1-4a8785e7f6aa None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.294919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad504aa-d668-4533-aaa1-4a8785e7f6aa None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.295222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad504aa-d668-4533-aaa1-4a8785e7f6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.304271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 773/1553] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.305354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f441f-4b30-4e46-9253-70ba9f43aafd None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.305640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f441f-4b30-4e46-9253-70ba9f43aafd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.305910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f441f-4b30-4e46-9253-70ba9f43aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.317260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6ad504aa-d668-4533-aaa1-4a8785e7f6aa None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.318476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6ad504aa-d668-4533-aaa1-4a8785e7f6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.326448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 781/1554] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.327353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ac1f441f-4b30-4e46-9253-70ba9f43aafd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.327665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c750-ba32-41e5-8ad4-9d32dad98c46 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.328522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c750-ba32-41e5-8ad4-9d32dad98c46 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.328807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c750-ba32-41e5-8ad4-9d32dad98c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.329099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ac1f441f-4b30-4e46-9253-70ba9f43aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.337947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 774/1555] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.338712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f441f-4b30-4e46-9253-70ba9f43aafd None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.350359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9033c750-ba32-41e5-8ad4-9d32dad98c46 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.351057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f441f-4b30-4e46-9253-70ba9f43aafd None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.351595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9033c750-ba32-41e5-8ad4-9d32dad98c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.356434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.357154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.357567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.357845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.358499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.359680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING py.warnings [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:47:10.359680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: warnings.warn(msg) Sep 01 16:47:10.359680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: Sep 01 16:47:10.360010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 782/1556] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.360810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c750-ba32-41e5-8ad4-9d32dad98c46 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.361052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.370654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c750-ba32-41e5-8ad4-9d32dad98c46 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.376750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f943c-2596-442b-b335-4b38860b8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.377639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f943c-2596-442b-b335-4b38860b8657 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.377918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f943c-2596-442b-b335-4b38860b8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.378183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f943c-2596-442b-b335-4b38860b8657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.378824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f943c-2596-442b-b335-4b38860b8657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.380517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f943c-2596-442b-b335-4b38860b8657 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.390809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 783/1557] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:10.392668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b83a4-e0f8-490a-a376-05775302934f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.392951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b83a4-e0f8-490a-a376-05775302934f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.393221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b83a4-e0f8-490a-a376-05775302934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.411664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-556b83a4-e0f8-490a-a376-05775302934f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.412846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-556b83a4-e0f8-490a-a376-05775302934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.420643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 784/1558] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.421923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9993a-93dd-4359-8098-26cad3b020a8 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.422205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9993a-93dd-4359-8098-26cad3b020a8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.422478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9993a-93dd-4359-8098-26cad3b020a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.436112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:10.442621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-78e9993a-93dd-4359-8098-26cad3b020a8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.443814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-78e9993a-93dd-4359-8098-26cad3b020a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.451492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 785/1559] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.452297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9993a-93dd-4359-8098-26cad3b020a8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.462065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9993a-93dd-4359-8098-26cad3b020a8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.466825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e11f75-4ba6-4f00-95ba-73a26560582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.467745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e11f75-4ba6-4f00-95ba-73a26560582e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.467745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e11f75-4ba6-4f00-95ba-73a26560582e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.467951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e11f75-4ba6-4f00-95ba-73a26560582e admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.468590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e11f75-4ba6-4f00-95ba-73a26560582e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:10.468893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e11f75-4ba6-4f00-95ba-73a26560582e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.470600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e11f75-4ba6-4f00-95ba-73a26560582e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.476429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 775/1560] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:10.476429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.482315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 786/1561] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:10.483546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858c93a-2021-4f35-abe5-eccb7024f300 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.483831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858c93a-2021-4f35-abe5-eccb7024f300 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.484105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858c93a-2021-4f35-abe5-eccb7024f300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.486531 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fb55b-7c6a-4efa-9f21-9a0212e7c3d3 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.492590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.493303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.493582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.496472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.496472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:10.496472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.496472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING py.warnings [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:47:10.496472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: warnings.warn(msg) Sep 01 16:47:10.496472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: Sep 01 16:47:10.497995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa028a-530b-45d0-b4a2-4379d4f0873d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.506706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8858c93a-2021-4f35-abe5-eccb7024f300 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.507245 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:10.508079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8858c93a-2021-4f35-abe5-eccb7024f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.513448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 776/1562] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:10.524760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd99e-13fe-46f7-b1b8-d8a8780fc159 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.524760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd99e-13fe-46f7-b1b8-d8a8780fc159 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.524760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fd99e-13fe-46f7-b1b8-d8a8780fc159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.525049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 787/1563] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.525049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858c93a-2021-4f35-abe5-eccb7024f300 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.533707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858c93a-2021-4f35-abe5-eccb7024f300 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.538373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.538968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.539287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.539557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.539668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a33fd99e-13fe-46f7-b1b8-d8a8780fc159 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:10.540193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.541023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a33fd99e-13fe-46f7-b1b8-d8a8780fc159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:10.541783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.550986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 777/1564] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:10.555927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 788/1565] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:10.556080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd99e-13fe-46f7-b1b8-d8a8780fc159 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.556190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.565686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b79dc-f0d9-4fea-8ee4-ae1d39cb44d1 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.567747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fd99e-13fe-46f7-b1b8-d8a8780fc159 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.570287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.570871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.571246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.571457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.572099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:10.572399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.573973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.574108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.574645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.575056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.575497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.576203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:10.576605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.578741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.586427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 789/1566] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:10.587660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.599017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a48fe-bcc5-434b-a372-c4e257987a95 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.601657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 778/1567] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:10.602557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.611863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.612669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.612983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b2da5-59c5-4883-8e20-7c2c8a8d72a1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.613178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.613864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.614602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.616560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.619427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.620180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.620458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.620734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.621406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.623618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.632221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 790/1568] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:10.632221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.640794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae0103-fe42-4e83-a071-f8b64f6fd490 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.646088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.646728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.647097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.647433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.648110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.651186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:47:10.651186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:47:10.651186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:47:10.651186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.714102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 779/1569] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:10.715552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.754461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 791/1570] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:10.754461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.784525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0b35-03bf-4df8-817f-519b182aaa6a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.815624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f87e3-ad88-42a3-9ae2-020ebef35475 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.820722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.821353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.821658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.821932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.822577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:10.822882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.824587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.836329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 792/1571] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:10.837255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.854485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f62dc-4232-41c5-ad8f-3a413d8235bc admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.854664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.855428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.855798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.856174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.857180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:10.857607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.860070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.860400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.860742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.861022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.861319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] PATH_INFO: `/v3/projects/1c72ff1682e542a0bed06fe56b2f65b0/users/ca168b3b94bb4e7584390e84f4d3de42/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.874558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 780/1572] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:10.875658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:10.885403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2111d6-f3a8-4c80-90e7-5bab9e8f5cd0 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:10.887475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c72ff1682e542a0bed06fe56b2f65b0, user_id=ca168b3b94bb4e7584390e84f4d3de42, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.888512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:47:10.888512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:47:10.888512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:47:10.890812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:10.890968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.891422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:10.891701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:10.891973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:10.892593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:10.894489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:10.968889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 793/1573] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:10 2022] PUT /identity/v3/projects/1c72ff1682e542a0bed06fe56b2f65b0/users/ca168b3b94bb4e7584390e84f4d3de42/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:10.969514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.010277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 781/1574] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:11.011256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.024454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:11.035177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f96f3-8a66-4ac6-8b74-bb2b8489d186 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.053089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:11.079738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78237f-c137-4b76-850c-a24e88da29fc admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.084447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.085081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.085491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.085774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.086424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.088066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.098082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 782/1575] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:11.099178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.100379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.101026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.101534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.101820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.102454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.104529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.110967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca39e9-ec6b-4520-9dd8-b39427e9662a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.115688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.116301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.116565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.116862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.117524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.120758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.191615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 783/1576] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:11 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:11.194570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.194723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 794/1577] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:10 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:11.195757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.206068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4c19-3fb0-44b0-af6b-48a2fe4c964c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.262021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc6f2-b392-4fcd-bf35-b9d0ca81a107 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.264161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.264771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.265148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.266060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.266702 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.268028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cc920-5260-4ebc-b896-769530376aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.268628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc920-5260-4ebc-b896-769530376aec admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.268730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.268906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc920-5260-4ebc-b896-769530376aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.269171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc920-5260-4ebc-b896-769530376aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.269845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cc920-5260-4ebc-b896-769530376aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.271772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cc920-5260-4ebc-b896-769530376aec admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.385676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 784/1578] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:11 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:11.386550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.396474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2952567-6db5-4392-bb2b-5bbe9f73f02c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.401026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.401592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.401871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.402146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.402752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.404707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.693890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 795/1579] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:11 2022] POST /identity/v3/projects => generated 403 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:11.693890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138901-e548-42c6-a918-a734b47e4bc1 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.693890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138901-e548-42c6-a918-a734b47e4bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.693890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138901-e548-42c6-a918-a734b47e4bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.712783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a9138901-e548-42c6-a918-a734b47e4bc1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:11.717674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a9138901-e548-42c6-a918-a734b47e4bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:11.771456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 796/1580] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:11.772250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9138901-e548-42c6-a918-a734b47e4bc1 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.781274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9138901-e548-42c6-a918-a734b47e4bc1 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.785839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.786423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.786700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.786971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.787629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.789542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.799488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:11.810253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 785/1581] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:11 2022] POST /identity/v3/projects => generated 385 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:11.811236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.873488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4b98e-d022-4c01-8ef9-f79b617f35b1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:11.878489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:11.879226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:11.879587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:11.879980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] PATH_INFO: `/v3/projects/f19e29d5ccc24e41bb2de472fdc2deb2/users/90c1309ba78a46f0b3a4cd67c4c89542/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:11.895933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19e29d5ccc24e41bb2de472fdc2deb2, user_id=90c1309ba78a46f0b3a4cd67c4c89542, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:11.898907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:11.979025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 786/1582] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:11 2022] PUT /identity/v3/projects/f19e29d5ccc24e41bb2de472fdc2deb2/users/90c1309ba78a46f0b3a4cd67c4c89542/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:11.982670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 797/1583] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:11 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:11.982836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.982940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:11.988257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:11.991901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27b0b-05c1-4763-a8cb-5de6ee0ed169 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.045471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bd3ba-a0a0-42f8-b2a1-28562e664f90 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.050899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.051641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.052007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.052268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.052909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.053898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.054509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.054684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.054807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.055046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.055702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.057604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.064914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 787/1584] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.065796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.075725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f461b4-bddd-45b4-926f-e00c1ce2ab47 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.082298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.082298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.082298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.082679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.082978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.084643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.095841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 788/1585] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.096712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.106790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa372b-b2a7-4249-9c33-2e2c67662baf admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.111830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.116795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.116795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.116795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.116795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.116795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.274707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 798/1586] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:11 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:12.274707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.274707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:12.304018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 789/1587] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:12 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:12.304826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.315111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185fa0-449c-4e20-bf4a-7a1670346110 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.319807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.320397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.320672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.320942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.321575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.323518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.336029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4c0b-50c2-480e-bf55-ba6ec8950039 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.339788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.340389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.340687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.340942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.350073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.351545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.362155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 799/1588] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:12.363242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.372107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2a6b-2c1f-4038-9d2a-b1dcd5db0f4c service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.377014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ac5b1-1d32-430b-abe3-087b36aaf48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.377952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac5b1-1d32-430b-abe3-087b36aaf48c admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.378282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac5b1-1d32-430b-abe3-087b36aaf48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.378624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac5b1-1d32-430b-abe3-087b36aaf48c admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.379360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ac5b1-1d32-430b-abe3-087b36aaf48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.381011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ac5b1-1d32-430b-abe3-087b36aaf48c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.392457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 800/1589] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.393634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3bb1-b2d5-4d21-a9bb-1830574192f8 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.393918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3bb1-b2d5-4d21-a9bb-1830574192f8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.394191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3bb1-b2d5-4d21-a9bb-1830574192f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.413208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-74dc3bb1-b2d5-4d21-a9bb-1830574192f8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:12.414406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-74dc3bb1-b2d5-4d21-a9bb-1830574192f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:12.421977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 801/1590] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:12.422728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc3bb1-b2d5-4d21-a9bb-1830574192f8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.432241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc3bb1-b2d5-4d21-a9bb-1830574192f8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.437056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.437640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.437915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.438181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.439346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.441038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.451237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 802/1591] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.452129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.461411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd030e-3017-42cf-b689-bb92da61fddc admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.466475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.467098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.467445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.467713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.468345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.470551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.473346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 790/1592] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:12 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:12.474423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.481074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 803/1593] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.481872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.486314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51006c-8944-4acc-b11c-bc10a794734e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.491208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.491796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.491922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2658d0c-b99d-4870-a06b-6c71a2236c3c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.492071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.492333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.492988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.494569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.496653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.497225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.497533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.497808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.498478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.502648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.506709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 791/1594] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.508368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.512804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 804/1595] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.514116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.519755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c94c1-70cf-48b8-882f-1bcff33d1308 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.525564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.526144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9127d2-08bc-43b4-8953-f46968ee8e45 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.526302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.526583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.526941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.527715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.529481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.530399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.531212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.531567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.531903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.543810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 792/1596] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.543810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.544097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.548619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.554601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286255f-8145-4105-b70c-d4b622b2879e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.555399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 805/1597] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:12.556247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.567092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d4bfb-063a-417e-9c1e-62310e750578 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.572189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.572864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.573145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.573471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.574204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.575947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.576085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.577231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.578089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.579284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] PATH_INFO: `/v3/projects/61c10634d382420c95133ed248fb75b0/users/d007a125826644e0acab2df34ee870a6/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.588497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 806/1598] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.589584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.598786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c10634d382420c95133ed248fb75b0, user_id=d007a125826644e0acab2df34ee870a6, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.600509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3443e-1b4a-471b-abef-c0c59a5d2faf admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.601561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.605701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.606384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.606683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.606990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] PATH_INFO: `/v3/projects/056c9795dd1f4c12b0b0ea7bc3acd981/users/2e85cf38dca74e4eb8eb1f3523d8e471/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.617319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.625091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056c9795dd1f4c12b0b0ea7bc3acd981, user_id=2e85cf38dca74e4eb8eb1f3523d8e471, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.628916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.729558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 793/1599] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:12 2022] PUT /identity/v3/projects/61c10634d382420c95133ed248fb75b0/users/d007a125826644e0acab2df34ee870a6/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:12.731079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.759202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 807/1600] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:12 2022] PUT /identity/v3/projects/056c9795dd1f4c12b0b0ea7bc3acd981/users/2e85cf38dca74e4eb8eb1f3523d8e471/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:12.760763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.862350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb403a8-20ba-48da-9638-cc11beaa3c1b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.867315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.867929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.868201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.872552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.872552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.872552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.874444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a833904-5f23-4ba2-bee9-76ba9d4f27a5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.882290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 794/1601] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.883223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.885014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.886345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.886988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.887926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.889469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.890594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.893622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.895119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a292f-0d1a-4d0b-b504-b0784a9277b6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.899963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd59ea9-6863-4cc0-b74d-13698111b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.900629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59ea9-6863-4cc0-b74d-13698111b142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.900901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59ea9-6863-4cc0-b74d-13698111b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.901169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59ea9-6863-4cc0-b74d-13698111b142 admin admin] PATH_INFO: `/v3/projects/7020cb9098f74e67aa08e9db52b6d231/users/1500bceab76f41c5b3e69e1cf55117aa/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.907126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 808/1602] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.908421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:12.916285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd59ea9-6863-4cc0-b74d-13698111b142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7020cb9098f74e67aa08e9db52b6d231, user_id=1500bceab76f41c5b3e69e1cf55117aa, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.919055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd59ea9-6863-4cc0-b74d-13698111b142 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.921579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da1920-e3bc-4c3f-b9d9-32eb4538cdd9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:12.927226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bf293-5a2a-4d52-a64e-fb8a291f1d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:12.927930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf293-5a2a-4d52-a64e-fb8a291f1d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.928281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf293-5a2a-4d52-a64e-fb8a291f1d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.928652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf293-5a2a-4d52-a64e-fb8a291f1d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.929297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bf293-5a2a-4d52-a64e-fb8a291f1d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:12.931275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bf293-5a2a-4d52-a64e-fb8a291f1d11 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:12.942911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 809/1603] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:12.944439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee9fb-0408-48b1-8ce9-b693d7800f0b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:12.944867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee9fb-0408-48b1-8ce9-b693d7800f0b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:12.945290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee9fb-0408-48b1-8ce9-b693d7800f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:12.981000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-885ee9fb-0408-48b1-8ce9-b693d7800f0b None None] MFA Rules not processed for user `d007a125826644e0acab2df34ee870a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:12.982250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-885ee9fb-0408-48b1-8ce9-b693d7800f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:13.000482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 795/1604] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:12 2022] PUT /identity/v3/projects/7020cb9098f74e67aa08e9db52b6d231/users/1500bceab76f41c5b3e69e1cf55117aa/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:13.003082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20acaa8-0d2d-4346-b281-38741a3541d6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.004747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20acaa8-0d2d-4346-b281-38741a3541d6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.004747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20acaa8-0d2d-4346-b281-38741a3541d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.030533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a20acaa8-0d2d-4346-b281-38741a3541d6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:13.032256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a20acaa8-0d2d-4346-b281-38741a3541d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:13.066055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 810/1605] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:13.066942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee9fb-0408-48b1-8ce9-b693d7800f0b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.078586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee9fb-0408-48b1-8ce9-b693d7800f0b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:13.111545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 796/1606] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:13.113089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20acaa8-0d2d-4346-b281-38741a3541d6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.139391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20acaa8-0d2d-4346-b281-38741a3541d6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:13.147337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae29a9-e66a-4f65-9c57-a1c2e8358a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:13.149043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae29a9-e66a-4f65-9c57-a1c2e8358a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.149043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae29a9-e66a-4f65-9c57-a1c2e8358a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.149449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae29a9-e66a-4f65-9c57-a1c2e8358a8b admin admin] PATH_INFO: `/v3/projects/5fda5b96a8a0496093b7a34414831204/users/547e5af1f4774a858c27b3a6502761ae/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.158377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:13.159278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.159622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.159962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] PATH_INFO: `/v3/projects/3f9fc92210ce42cdbdcbca9463fd2575/users/cfc0bc2c127e489f87ee597bdcec63a1/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.164052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:13.172016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae29a9-e66a-4f65-9c57-a1c2e8358a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fda5b96a8a0496093b7a34414831204, user_id=547e5af1f4774a858c27b3a6502761ae, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:13.175475 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae29a9-e66a-4f65-9c57-a1c2e8358a8b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:13.176285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9fc92210ce42cdbdcbca9463fd2575, user_id=cfc0bc2c127e489f87ee597bdcec63a1, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:13.179178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:13.273120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 811/1607] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:13 2022] PUT /identity/v3/projects/3f9fc92210ce42cdbdcbca9463fd2575/users/cfc0bc2c127e489f87ee597bdcec63a1/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:13.273120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.276873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 797/1608] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:13 2022] PUT /identity/v3/projects/5fda5b96a8a0496093b7a34414831204/users/547e5af1f4774a858c27b3a6502761ae/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:13.278752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9d8f-cc3d-4158-93fc-aebbfc0591da None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.279228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9d8f-cc3d-4158-93fc-aebbfc0591da None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.279736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9d8f-cc3d-4158-93fc-aebbfc0591da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.309617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-db1d9d8f-cc3d-4158-93fc-aebbfc0591da None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:13.311306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-db1d9d8f-cc3d-4158-93fc-aebbfc0591da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:13.366862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4bbff-5c65-476a-9868-adb8f2791c0a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:13.383403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 798/1609] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:13.384348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d9d8f-cc3d-4158-93fc-aebbfc0591da None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.396515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d9d8f-cc3d-4158-93fc-aebbfc0591da None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:13.401691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:13.402296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.402568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.402837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.403506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:13.405724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:13.450165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01508e8-96af-42ed-b9a5-6667834741f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:13.451239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01508e8-96af-42ed-b9a5-6667834741f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.451729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01508e8-96af-42ed-b9a5-6667834741f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.452169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01508e8-96af-42ed-b9a5-6667834741f6 admin admin] PATH_INFO: `/v3/projects/cf3d1806e48f4adaa2072a6c5df8a3ae/users/cc11739c0ba74a319fecdd1ba015f3f2/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.471722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01508e8-96af-42ed-b9a5-6667834741f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3d1806e48f4adaa2072a6c5df8a3ae, user_id=cc11739c0ba74a319fecdd1ba015f3f2, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:13.474496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01508e8-96af-42ed-b9a5-6667834741f6 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:13.530579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 799/1610] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:13.531521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.558792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 812/1611] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:13 2022] PUT /identity/v3/projects/cf3d1806e48f4adaa2072a6c5df8a3ae/users/cc11739c0ba74a319fecdd1ba015f3f2/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:13.562197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a842e17-9a3e-4470-adc0-8e7494b3105d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.562481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a842e17-9a3e-4470-adc0-8e7494b3105d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.574338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a842e17-9a3e-4470-adc0-8e7494b3105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.577666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:13.605783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7396-2774-464c-b611-d519c081d094 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:13.609533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9a842e17-9a3e-4470-adc0-8e7494b3105d None None] MFA Rules not processed for user `cfc0bc2c127e489f87ee597bdcec63a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:13.611372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9a842e17-9a3e-4470-adc0-8e7494b3105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:13.676423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:13.677235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.677409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.677634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.698588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 813/1612] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:13.699965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c837-fb77-42c3-8649-40abd936194b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.700257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c837-fb77-42c3-8649-40abd936194b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.700532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c837-fb77-42c3-8649-40abd936194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.709486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:13.735098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e120c837-fb77-42c3-8649-40abd936194b None None] MFA Rules not processed for user `547e5af1f4774a858c27b3a6502761ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:13.738053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e120c837-fb77-42c3-8649-40abd936194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:13.779918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:13.781439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:13.793729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 800/1613] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:13.794790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.803978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13d7a-e287-4b45-b654-1c5f4a0e07ee service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:13.808273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0b226-7760-43e2-afe1-3572ee458b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:13.809076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0b226-7760-43e2-afe1-3572ee458b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.809476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0b226-7760-43e2-afe1-3572ee458b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.809843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0b226-7760-43e2-afe1-3572ee458b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.820505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0b226-7760-43e2-afe1-3572ee458b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:13.820948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 814/1614] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:13.821776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120c837-fb77-42c3-8649-40abd936194b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.822123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0b226-7760-43e2-afe1-3572ee458b94 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:13.833751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 801/1615] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:13.834473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120c837-fb77-42c3-8649-40abd936194b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:13.835377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a8ff-3f91-4770-b07f-e8c0b59db3d3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.835661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a8ff-3f91-4770-b07f-e8c0b59db3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.836346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a8ff-3f91-4770-b07f-e8c0b59db3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.839995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2d89-1e9f-4795-8202-9e7d215f0ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:13.840667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2d89-1e9f-4795-8202-9e7d215f0ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.841055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2d89-1e9f-4795-8202-9e7d215f0ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.841460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2d89-1e9f-4795-8202-9e7d215f0ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.842539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2d89-1e9f-4795-8202-9e7d215f0ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:13.845282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2d89-1e9f-4795-8202-9e7d215f0ed2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:13.879017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b105a8ff-3f91-4770-b07f-e8c0b59db3d3 None None] MFA Rules not processed for user `cc11739c0ba74a319fecdd1ba015f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:13.880715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b105a8ff-3f91-4770-b07f-e8c0b59db3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:13.968268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 802/1616] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:13.971070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4179d-34ee-443d-9c85-0f7403e65bda None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:13.971558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4179d-34ee-443d-9c85-0f7403e65bda None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:13.972012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4179d-34ee-443d-9c85-0f7403e65bda None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:13.975788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 803/1617] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 1 16:47:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:47:13.977198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4179d-34ee-443d-9c85-0f7403e65bda None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:13.998433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4179d-34ee-443d-9c85-0f7403e65bda None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:14.003974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 815/1618] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:14.003974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7fbd8-29f7-4864-91fd-cab11908d169 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.003974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7fbd8-29f7-4864-91fd-cab11908d169 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.003974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7fbd8-29f7-4864-91fd-cab11908d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.012482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba10f-0a0e-4b90-8c3d-177c3ccb9d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:14.014140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba10f-0a0e-4b90-8c3d-177c3ccb9d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.015286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba10f-0a0e-4b90-8c3d-177c3ccb9d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.016081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba10f-0a0e-4b90-8c3d-177c3ccb9d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.017361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba10f-0a0e-4b90-8c3d-177c3ccb9d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:14.025999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba10f-0a0e-4b90-8c3d-177c3ccb9d39 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:14.073436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:14.081117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-bab7fbd8-29f7-4864-91fd-cab11908d169 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:14.082361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bab7fbd8-29f7-4864-91fd-cab11908d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:14.154528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 816/1619] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 1 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:14.155624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7fbd8-29f7-4864-91fd-cab11908d169 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:14.175820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 804/1620] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:13 2022] POST /identity/v3/projects => generated 405 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:14.175820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622c121-28ba-436c-831d-c6686a4170e7 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.176125 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622c121-28ba-436c-831d-c6686a4170e7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.176549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622c121-28ba-436c-831d-c6686a4170e7 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.180837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 805/1621] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 1 16:47:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:47:14.183352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622c121-28ba-436c-831d-c6686a4170e7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:14.186058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7fbd8-29f7-4864-91fd-cab11908d169 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:14.281227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b26d44-c1d8-477c-9301-fb6dd888711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:14.281976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26d44-c1d8-477c-9301-fb6dd888711c admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.282322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26d44-c1d8-477c-9301-fb6dd888711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.282518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26d44-c1d8-477c-9301-fb6dd888711c admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.283258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b26d44-c1d8-477c-9301-fb6dd888711c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:14.285099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b26d44-c1d8-477c-9301-fb6dd888711c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:14.302265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 817/1622] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:14.303835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d41a3-f029-4328-8feb-5dc34f3d4adb None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.304306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d41a3-f029-4328-8feb-5dc34f3d4adb None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.304641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d41a3-f029-4328-8feb-5dc34f3d4adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.325662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622c121-28ba-436c-831d-c6686a4170e7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:14.331807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-643d41a3-f029-4328-8feb-5dc34f3d4adb None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:14.332860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:14.333265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-643d41a3-f029-4328-8feb-5dc34f3d4adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:14.334302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.334580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.334850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.335572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:14.337627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:14.423830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 818/1623] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 1 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:14.424767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d41a3-f029-4328-8feb-5dc34f3d4adb None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:14.435635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d41a3-f029-4328-8feb-5dc34f3d4adb None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:14.441912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:14.442510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.442788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.443059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.509671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:14.511284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:14.520190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 819/1624] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:14.520979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:14.530546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443bfe-e674-4207-99bc-dd2117f91d26 service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:14.535198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:14.535838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.536117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.536387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] PATH_INFO: `/v3/projects/a2ce10d2cfd34cd18566f28a4d11c44a/users/7abb886c7e084beeb7a4a80d3d9d12bc/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.618417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:14.618417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ce10d2cfd34cd18566f28a4d11c44a, user_id=7abb886c7e084beeb7a4a80d3d9d12bc, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:14.618417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:14.837467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 820/1625] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:14 2022] PUT /identity/v3/projects/a2ce10d2cfd34cd18566f28a4d11c44a/users/7abb886c7e084beeb7a4a80d3d9d12bc/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:14.838516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:14.839114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 806/1626] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:14 2022] POST /identity/v3/users => generated 309 bytes in 658 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:14.840033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:14.864828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4145-7493-455e-a72f-b5c8846434f0 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:14.940434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:14.941127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:14.941722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:14.942075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:14.943516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:14.947137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:14.967361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 807/1627] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:14.968311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:14.987567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195fd3c-edad-40b7-ac5e-211fbafc10f9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:14.992709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36592e-01e2-4104-beca-bdccf18ebb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.186271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36592e-01e2-4104-beca-bdccf18ebb14 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.186271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36592e-01e2-4104-beca-bdccf18ebb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.186271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36592e-01e2-4104-beca-bdccf18ebb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.196859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf48d07-9b32-47cf-a73e-14a96781cdc5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:15.199269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36592e-01e2-4104-beca-bdccf18ebb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.199269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36592e-01e2-4104-beca-bdccf18ebb14 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:15.200143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271da9a7-0435-44c2-9187-0a2a5ebcfd4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.200405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 808/1628] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:15.200405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aaacc-b56a-4871-815b-f2b8af8fda66 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.200405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aaacc-b56a-4871-815b-f2b8af8fda66 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.200405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aaacc-b56a-4871-815b-f2b8af8fda66 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.200405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 809/1629] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 1 16:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:47:15.200731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271da9a7-0435-44c2-9187-0a2a5ebcfd4a service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.200731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271da9a7-0435-44c2-9187-0a2a5ebcfd4a service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.200907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aaacc-b56a-4871-815b-f2b8af8fda66 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:15.201036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271da9a7-0435-44c2-9187-0a2a5ebcfd4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.202443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aaacc-b56a-4871-815b-f2b8af8fda66 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:15.202443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.202443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.202443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.207536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] PATH_INFO: `/v3/projects/bb8378fcb1804b0c8627aaff87e145d0/users/f2364de8780e491f85d5c96d1e836f3b/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.207536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8378fcb1804b0c8627aaff87e145d0, user_id=f2364de8780e491f85d5c96d1e836f3b, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.207536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:15.208002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271da9a7-0435-44c2-9187-0a2a5ebcfd4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.208002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271da9a7-0435-44c2-9187-0a2a5ebcfd4a service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:15.208245 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 810/1630] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:15 2022] PUT /identity/v3/projects/bb8378fcb1804b0c8627aaff87e145d0/users/f2364de8780e491f85d5c96d1e836f3b/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:15.208245 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:15.208472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 821/1631] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:15.208472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8648c14-c35d-497d-85f0-986e7f223d8e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.208472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8648c14-c35d-497d-85f0-986e7f223d8e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.208472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8648c14-c35d-497d-85f0-986e7f223d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.238111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b8648c14-c35d-497d-85f0-986e7f223d8e None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:15.239611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b8648c14-c35d-497d-85f0-986e7f223d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:15.313773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0a8e-7aee-4d61-9264-d1d8b07b2ad6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:15.318817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.319552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.319832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.320107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] PATH_INFO: `/v3/projects/a2ce10d2cfd34cd18566f28a4d11c44a/users/7abb886c7e084beeb7a4a80d3d9d12bc/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.323550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ce10d2cfd34cd18566f28a4d11c44a, user_id=7abb886c7e084beeb7a4a80d3d9d12bc, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.326246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:15.361460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 811/1632] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:15 2022] PUT /identity/v3/projects/a2ce10d2cfd34cd18566f28a4d11c44a/users/7abb886c7e084beeb7a4a80d3d9d12bc/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:15.362477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:15.367509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 822/1633] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:15.372156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799522f-4caf-4b0e-aa41-a54b8fe11e56 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.372496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799522f-4caf-4b0e-aa41-a54b8fe11e56 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.372863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799522f-4caf-4b0e-aa41-a54b8fe11e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.471521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b799522f-4caf-4b0e-aa41-a54b8fe11e56 None None] MFA Rules not processed for user `7abb886c7e084beeb7a4a80d3d9d12bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:15.476151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b799522f-4caf-4b0e-aa41-a54b8fe11e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:15.491518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ef66-6f6c-444a-8bb1-cdc92b16ebf6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:15.503483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.504198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.504474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.504741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.505463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.508303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:15.542671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 812/1634] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:15.542671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:15.616547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54137bb5-baa5-4d44-b95e-357aaae639a8 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:15.621838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aca381-e5da-42c6-8ad3-a7c634f3ab5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.622528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca381-e5da-42c6-8ad3-a7c634f3ab5d service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.622817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca381-e5da-42c6-8ad3-a7c634f3ab5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.623187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca381-e5da-42c6-8ad3-a7c634f3ab5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.689780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 823/1635] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:15.690811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799522f-4caf-4b0e-aa41-a54b8fe11e56 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:15.716762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799522f-4caf-4b0e-aa41-a54b8fe11e56 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:15.730684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0584c5-bdc2-4388-8768-8fdf4f516cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.731406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0584c5-bdc2-4388-8768-8fdf4f516cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.731816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0584c5-bdc2-4388-8768-8fdf4f516cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.732100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0584c5-bdc2-4388-8768-8fdf4f516cc8 admin admin] PATH_INFO: `/v3/projects/bb8378fcb1804b0c8627aaff87e145d0/users/f2364de8780e491f85d5c96d1e836f3b/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.734038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca381-e5da-42c6-8ad3-a7c634f3ab5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.741706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0584c5-bdc2-4388-8768-8fdf4f516cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8378fcb1804b0c8627aaff87e145d0, user_id=f2364de8780e491f85d5c96d1e836f3b, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.741851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca381-e5da-42c6-8ad3-a7c634f3ab5d service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:15.745547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0584c5-bdc2-4388-8768-8fdf4f516cc8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:15.765090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 824/1636] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:15 2022] PUT /identity/v3/projects/bb8378fcb1804b0c8627aaff87e145d0/users/f2364de8780e491f85d5c96d1e836f3b/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:15.766547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7d2f-8e58-4cca-b61a-533b4905b60f None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.767783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7d2f-8e58-4cca-b61a-533b4905b60f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.768075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f7d2f-8e58-4cca-b61a-533b4905b60f None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.769811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 825/1637] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 1 16:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:47:15.771207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 813/1638] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:15.774575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f7d2f-8e58-4cca-b61a-533b4905b60f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:15.777890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5423f-49ed-450a-a6aa-49f3740a8f36 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.778890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5423f-49ed-450a-a6aa-49f3740a8f36 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.779541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5423f-49ed-450a-a6aa-49f3740a8f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.824721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:15.834471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-91d5423f-49ed-450a-a6aa-49f3740a8f36 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:15.836058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-91d5423f-49ed-450a-a6aa-49f3740a8f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:15.870983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f7d2f-8e58-4cca-b61a-533b4905b60f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:15.875917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:15.876618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:15.877421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:15.877695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:15.979375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:15.980829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:16.009897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 814/1639] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:16.011330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36113-7a4e-4905-892a-15a3e465496e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:16.011617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36113-7a4e-4905-892a-15a3e465496e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:16.011950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36113-7a4e-4905-892a-15a3e465496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:16.031731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 826/1640] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:16.054048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:16.056517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:16.073643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d3a3-f901-43cc-b42e-5800880535a6 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:16.088806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:16.092970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:16.092970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:16.092970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:16.113242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:16.114629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:16.138934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1ba36113-7a4e-4905-892a-15a3e465496e None None] MFA Rules not processed for user `f2364de8780e491f85d5c96d1e836f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:16.143969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1ba36113-7a4e-4905-892a-15a3e465496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:16.165234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 827/1641] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:16.394988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 815/1642] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:16.536677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:16.549780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dfa2f-e6e1-4f62-b5ab-e0c75e313516 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:16.555076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57092-c036-49f6-8129-bffb69a4d461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:16.557510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57092-c036-49f6-8129-bffb69a4d461 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:16.557753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57092-c036-49f6-8129-bffb69a4d461 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:16.558073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57092-c036-49f6-8129-bffb69a4d461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:16.600630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57092-c036-49f6-8129-bffb69a4d461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:16.604162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57092-c036-49f6-8129-bffb69a4d461 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:16.624070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 828/1643] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:16 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:16.799182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36113-7a4e-4905-892a-15a3e465496e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:16.890617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba36113-7a4e-4905-892a-15a3e465496e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:16.896895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:16.897554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:16.897841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:16.898240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] PATH_INFO: `/v3/users/cfc0bc2c127e489f87ee597bdcec63a1` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:16.899834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc0bc2c127e489f87ee597bdcec63a1)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:16.901804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:17.060856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:17.084306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:17.084744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:17.085069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:17.166788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:17.178087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc0bc2c127e489f87ee597bdcec63a1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:17.203609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] MFA Rules not processed for user `2e85cf38dca74e4eb8eb1f3523d8e471`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:17.207138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:17.225971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc0bc2c127e489f87ee597bdcec63a1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:17.245839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc0bc2c127e489f87ee597bdcec63a1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:17.248519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc0bc2c127e489f87ee597bdcec63a1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:17.250812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b71a22a-1a76-4070-bb98-1ffe77cb9691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc0bc2c127e489f87ee597bdcec63a1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:17.347883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 829/1644] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:17.352075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:17.353777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:17.373197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 816/1645] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:16 2022] DELETE /identity/v3/users/cfc0bc2c127e489f87ee597bdcec63a1 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:17.375896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:17.376223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:17.376498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:17.391110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb24b-b88a-4884-859d-d0cbeee75243 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:17.421794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:17.424632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:17.500517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:17.501230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:17.501509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:17.501769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:17.502792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:17.508190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:17.554785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 817/1646] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:17.555726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:17.557073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:17.571581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a75308-1916-47ea-aba1-2a69c8084ad4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:17.576777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:17.577861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:17.578179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:17.578467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] PATH_INFO: `/v3/users/547e5af1f4774a858c27b3a6502761ae` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:17.580396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547e5af1f4774a858c27b3a6502761ae)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:17.582599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:17.857976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 830/1647] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:17 2022] POST /identity/v3/projects => generated 405 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:47:17.859122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:17.867839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:17.971525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aca6fb-8e04-41fc-bfb1-baff2f2cab82 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:17.975987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:17.977001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:17.977459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:17.977894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.034228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547e5af1f4774a858c27b3a6502761ae'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:18.068291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547e5af1f4774a858c27b3a6502761ae'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:18.089744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547e5af1f4774a858c27b3a6502761ae'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:18.090825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547e5af1f4774a858c27b3a6502761ae'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:18.091759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b516923c-242d-460b-b25a-b50f6f885752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547e5af1f4774a858c27b3a6502761ae'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:18.114455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.115968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.138227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 831/1648] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:18.139074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:18.158468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad35f2-32fe-4c04-b584-2899cd74c5cb service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:18.175907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:18.176536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.176816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.177105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.177959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.186271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.222018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 818/1649] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:17 2022] DELETE /identity/v3/users/547e5af1f4774a858c27b3a6502761ae => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:18.228108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d21cc-3839-4caf-8e3f-724c1b17f503 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.228927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d21cc-3839-4caf-8e3f-724c1b17f503 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.229490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d21cc-3839-4caf-8e3f-724c1b17f503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.285069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-483d21cc-3839-4caf-8e3f-724c1b17f503 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:18.290806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-483d21cc-3839-4caf-8e3f-724c1b17f503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:18.317093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 832/1650] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:18 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:18.318040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:18.319813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:18.343331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147a49c-b659-47fe-9968-21657bbcdb0a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:18.433658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 819/1651] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:18.465637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:18.466256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.466539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.466809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.467493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.469114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.483274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 833/1652] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:18.484330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d21cc-3839-4caf-8e3f-724c1b17f503 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:18.507886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:18.508024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d21cc-3839-4caf-8e3f-724c1b17f503 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:18.508099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:18.509072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:18.510744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.511368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.511368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] PATH_INFO: `/v3/projects/ab688a0e2e10438580dae575528c884b/users/3e4b0dac1e584f0e878f0d80fd04acbb/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.570919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab688a0e2e10438580dae575528c884b, user_id=3e4b0dac1e584f0e878f0d80fd04acbb, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.574098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.601612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160abf-3850-4d1e-8333-92ce1735cf04 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:18.605406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:18.606071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.606350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.606623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.621794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.625108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.637845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 834/1653] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:18.638253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:18.639910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:18.673821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cb4f0-7046-4cd8-8c09-ebf18d181b2f service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:18.680830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 820/1654] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:18 2022] PUT /identity/v3/projects/ab688a0e2e10438580dae575528c884b/users/3e4b0dac1e584f0e878f0d80fd04acbb/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:47:18.682566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:18.760027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:18.761364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.761786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.762278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] PATH_INFO: `/v3/users/d007a125826644e0acab2df34ee870a6` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.763979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d007a125826644e0acab2df34ee870a6)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.765164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: WARNING py.warnings [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:47:18.765164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: warnings.warn(msg) Sep 01 16:47:18.765164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: Sep 01 16:47:18.767882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.853039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ea9c8-38a9-4354-8088-74df646f1024 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:18.859633 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:18.860977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.861392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.861797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.862586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.864585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.899399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 821/1655] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:18.901250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:18.922719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb494a8a-9edd-4274-bbd0-55bd89c7cb21 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:18.944676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bacd2-aa0c-4094-99e3-6f1877747fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:18.946402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bacd2-aa0c-4094-99e3-6f1877747fde admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:18.946874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bacd2-aa0c-4094-99e3-6f1877747fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:18.947838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bacd2-aa0c-4094-99e3-6f1877747fde admin admin] PATH_INFO: `/v3/projects/ab688a0e2e10438580dae575528c884b/users/3e4b0dac1e584f0e878f0d80fd04acbb/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:18.951514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bacd2-aa0c-4094-99e3-6f1877747fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab688a0e2e10438580dae575528c884b, user_id=3e4b0dac1e584f0e878f0d80fd04acbb, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:18.955746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778bacd2-aa0c-4094-99e3-6f1877747fde admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:18.968957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 822/1656] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:18 2022] PUT /identity/v3/projects/ab688a0e2e10438580dae575528c884b/users/3e4b0dac1e584f0e878f0d80fd04acbb/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:19.036265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd007a125826644e0acab2df34ee870a6'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:19.037001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd007a125826644e0acab2df34ee870a6'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:19.049527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd007a125826644e0acab2df34ee870a6'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:19.136339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:19.146595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd007a125826644e0acab2df34ee870a6'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:19.191129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:19.198497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd007a125826644e0acab2df34ee870a6'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:19.244364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:19.244364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:19.244591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 835/1657] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:18 2022] DELETE /identity/v3/users/d007a125826644e0acab2df34ee870a6 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:19.244680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:19.288498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:19.289760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:19.408069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 823/1658] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:19.435620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:19.437502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:19.541617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa892-cf04-43e8-b549-10a4b295e56e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:19.545960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:19.546604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:19.546884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:19.547225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:19.559751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:19.561959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:19.574466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 836/1659] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:19.792539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:19.794625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:19.796431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:19.798517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:19.820174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076549e-5fbc-4686-8be7-04096aa15473 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:19.822493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878af5e-9471-4c56-b959-a1f26dda2772 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:19.833743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:19.834732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:19.836019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:19.836341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:19.836838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] PATH_INFO: `/v3/projects/3f9fc92210ce42cdbdcbca9463fd2575` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:19.837156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:19.837859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:19.838146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] PATH_INFO: `/v3/projects/5fda5b96a8a0496093b7a34414831204` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:19.841852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9fc92210ce42cdbdcbca9463fd2575)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:19.844060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: WARNING py.warnings [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:47:19.844060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: warnings.warn(msg) Sep 01 16:47:19.844060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: Sep 01 16:47:19.845967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fda5b96a8a0496093b7a34414831204)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:19.848358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:19.848471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:20.074721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fda5b96a8a0496093b7a34414831204', 'request_id': 'req-936dfcb7-ec5a-4ff9-8639-e68f293aff02'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.096093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9fc92210ce42cdbdcbca9463fd2575', 'request_id': 'req-084e325b-548c-4fed-a6e8-202f4cc798d4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.098920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fda5b96a8a0496093b7a34414831204', 'request_id': 'req-936dfcb7-ec5a-4ff9-8639-e68f293aff02'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.134113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:20.142792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9fc92210ce42cdbdcbca9463fd2575', 'request_id': 'req-084e325b-548c-4fed-a6e8-202f4cc798d4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.200356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fda5b96a8a0496093b7a34414831204', 'request_id': 'req-936dfcb7-ec5a-4ff9-8639-e68f293aff02'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.222529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] The token cache is being invalidate because project 5fda5b96a8a0496093b7a34414831204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:20.223060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.224115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.228587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 837/1660] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:19 2022] DELETE /identity/v3/projects/5fda5b96a8a0496093b7a34414831204 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:20.231131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:20.232624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:20.276871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9fc92210ce42cdbdcbca9463fd2575', 'request_id': 'req-084e325b-548c-4fed-a6e8-202f4cc798d4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.322172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] The token cache is being invalidate because project 3f9fc92210ce42cdbdcbca9463fd2575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:20.322525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.323445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-084e325b-548c-4fed-a6e8-202f4cc798d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.327237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 824/1661] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:19 2022] DELETE /identity/v3/projects/3f9fc92210ce42cdbdcbca9463fd2575 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:20.332757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f34f0-0e08-408f-bee3-55ccd0533629 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:20.333055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f34f0-0e08-408f-bee3-55ccd0533629 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:20.333329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f34f0-0e08-408f-bee3-55ccd0533629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:20.359985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dfcb7-ec5a-4ff9-8639-e68f293aff02 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:20.388730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:20.389440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:20.389875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:20.391644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] PATH_INFO: `/v3/users/f2364de8780e491f85d5c96d1e836f3b` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:20.395209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2364de8780e491f85d5c96d1e836f3b)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:20.397383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:20.400613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a79f34f0-0e08-408f-bee3-55ccd0533629 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:20.401950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a79f34f0-0e08-408f-bee3-55ccd0533629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:20.439931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 825/1662] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:20.441421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9763014-9c5c-4c99-905e-f228c2c49134 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:20.441707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9763014-9c5c-4c99-905e-f228c2c49134 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:20.442080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9763014-9c5c-4c99-905e-f228c2c49134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:20.496324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c9763014-9c5c-4c99-905e-f228c2c49134 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:20.497554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c9763014-9c5c-4c99-905e-f228c2c49134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:20.518648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 826/1663] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:20.524333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9763014-9c5c-4c99-905e-f228c2c49134 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:20.543518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9763014-9c5c-4c99-905e-f228c2c49134 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:20.557413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:20.558046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:20.558914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:20.559283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:20.559961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:20.560269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:20.562499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:20.591397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 827/1664] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:20.595817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:20.617772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255d4e6-c0bd-4b2f-b7f6-e0e7fbe4784b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:20.622792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:20.623502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:20.624986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:20.624986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:20.624986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:20.627574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:20.753672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2364de8780e491f85d5c96d1e836f3b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.754641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2364de8780e491f85d5c96d1e836f3b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.766169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2364de8780e491f85d5c96d1e836f3b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.772314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 828/1665] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:20 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:47:20.776944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:20.797526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:20.888293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2364de8780e491f85d5c96d1e836f3b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.918502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2364de8780e491f85d5c96d1e836f3b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:20.940583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 838/1666] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:20 2022] DELETE /identity/v3/users/f2364de8780e491f85d5c96d1e836f3b => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:20.978214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96f047-9e20-4ad8-96a6-48d666f7f83c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:21.130747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:21.131797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:21.132917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:21.134225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:21.135331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:21.145645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:21.218387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:21.219978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:21.246050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033f80-f190-4430-b29c-42e376f3fc1f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:21.255060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:21.255742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:21.256024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:21.256301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] PATH_INFO: `/v3/projects/61c10634d382420c95133ed248fb75b0` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:21.264058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c10634d382420c95133ed248fb75b0)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:21.264058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:21.357769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 829/1667] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:20 2022] POST /identity/v3/users => generated 291 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:47:21.365141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:21.372147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:21.404090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91e9c-54c2-4ada-844b-90f609be7918 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:21.409886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:21.410781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:21.411213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:21.411617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:21.413030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:21.415729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:21.442014 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 830/1668] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:21.443489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:21.482076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69e2f3-9d76-4270-bf39-e148dc79208b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:21.493816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c10634d382420c95133ed248fb75b0', 'request_id': 'req-ca06bbc8-b416-4956-bb81-7be4c0d683a7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:21.507741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c10634d382420c95133ed248fb75b0', 'request_id': 'req-ca06bbc8-b416-4956-bb81-7be4c0d683a7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:21.602250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c10634d382420c95133ed248fb75b0', 'request_id': 'req-ca06bbc8-b416-4956-bb81-7be4c0d683a7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:21.603150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:21.606645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:21.606935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:21.607227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:21.614051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:21.614051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:21.653248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] The token cache is being invalidate because project 61c10634d382420c95133ed248fb75b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:21.653540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:21.658492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:21.664034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 839/1669] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:21 2022] DELETE /identity/v3/projects/61c10634d382420c95133ed248fb75b0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:21.667474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:21.669622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 831/1670] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:21.671386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:21.674793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:21.684688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:21.714041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06bbc8-b416-4956-bb81-7be4c0d683a7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:21.716662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad479a-758f-43b0-9b1d-89919b637520 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:21.727836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23858b-5883-4cef-b31b-0e3cd4eef135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:21.728529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23858b-5883-4cef-b31b-0e3cd4eef135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:21.728804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23858b-5883-4cef-b31b-0e3cd4eef135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:21.728903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:21.729073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23858b-5883-4cef-b31b-0e3cd4eef135 admin admin] PATH_INFO: `/v3/projects/9c2090efd502489cb6ae7b6280cb21b0/users/5b537d46a7ed4838b3645c0a8ebdf044/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:21.729522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:21.734199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:21.737471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] PATH_INFO: `/v3/users/7abb886c7e084beeb7a4a80d3d9d12bc` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:21.739456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abb886c7e084beeb7a4a80d3d9d12bc)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:21.751490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:21.774699 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:21.791019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23858b-5883-4cef-b31b-0e3cd4eef135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2090efd502489cb6ae7b6280cb21b0, user_id=5b537d46a7ed4838b3645c0a8ebdf044, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:21.793753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23858b-5883-4cef-b31b-0e3cd4eef135 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:21.889307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 840/1671] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:21 2022] PUT /identity/v3/projects/9c2090efd502489cb6ae7b6280cb21b0/users/5b537d46a7ed4838b3645c0a8ebdf044/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:21.890971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709be6bc-d0bd-484b-bbe0-d16695ca5a21 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:21.891869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709be6bc-d0bd-484b-bbe0-d16695ca5a21 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:21.897094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709be6bc-d0bd-484b-bbe0-d16695ca5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:21.960044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-709be6bc-d0bd-484b-bbe0-d16695ca5a21 None None] MFA Rules not processed for user `3e4b0dac1e584f0e878f0d80fd04acbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:21.963363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-709be6bc-d0bd-484b-bbe0-d16695ca5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:22.056706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abb886c7e084beeb7a4a80d3d9d12bc'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.081764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abb886c7e084beeb7a4a80d3d9d12bc'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.092798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abb886c7e084beeb7a4a80d3d9d12bc'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.093818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abb886c7e084beeb7a4a80d3d9d12bc'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.094625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abb886c7e084beeb7a4a80d3d9d12bc'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.147116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 841/1672] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:22.149968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:22.150873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:22.151374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:22.192843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] MFA Rules not processed for user `5b537d46a7ed4838b3645c0a8ebdf044`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:22.194428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:22.219227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 832/1673] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:21 2022] DELETE /identity/v3/users/7abb886c7e084beeb7a4a80d3d9d12bc => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:22.221331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:22.223087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:22.289727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 842/1674] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:22.295074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:22.296600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:22.346852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62a862-9587-4173-8e2a-2b82e37b870b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:22.352918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:22.353774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:22.353971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:22.354235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] PATH_INFO: `/v3/projects/bb8378fcb1804b0c8627aaff87e145d0` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:22.355875 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8378fcb1804b0c8627aaff87e145d0)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:22.357596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:22.479725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263650-8bbd-4819-a0f1-419caa16ed05 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:22.495191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:22.495590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:22.495828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:22.496467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:22.496758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:22.498815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:22.535881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8378fcb1804b0c8627aaff87e145d0', 'request_id': 'req-d05f589f-306e-470c-81d3-d9e5a7495275'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.549725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8378fcb1804b0c8627aaff87e145d0', 'request_id': 'req-d05f589f-306e-470c-81d3-d9e5a7495275'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.694206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8378fcb1804b0c8627aaff87e145d0', 'request_id': 'req-d05f589f-306e-470c-81d3-d9e5a7495275'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.719203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] The token cache is being invalidate because project bb8378fcb1804b0c8627aaff87e145d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:22.719203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.720115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d05f589f-306e-470c-81d3-d9e5a7495275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:22.722082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 833/1675] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:22 2022] DELETE /identity/v3/projects/bb8378fcb1804b0c8627aaff87e145d0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:22.726493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92a3fa-f752-4dcf-9607-2551e724b925 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:22.726925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92a3fa-f752-4dcf-9607-2551e724b925 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:22.727304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92a3fa-f752-4dcf-9607-2551e724b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:22.735921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 843/1676] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:22 2022] POST /identity/v3/projects => generated 381 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:22.737384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:22.741069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:22.784748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1b92a3fa-f752-4dcf-9607-2551e724b925 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:22.784748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1b92a3fa-f752-4dcf-9607-2551e724b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:22.978040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 834/1677] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:22.993786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd374cd-aa7e-4859-b844-96cb019a614e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:22.994589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd374cd-aa7e-4859-b844-96cb019a614e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:22.995048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd374cd-aa7e-4859-b844-96cb019a614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:22.997197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9209fb-ec6c-4739-a777-7b4acf4a88a4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.021189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-bcd374cd-aa7e-4859-b844-96cb019a614e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:23.025401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bcd374cd-aa7e-4859-b844-96cb019a614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:23.033104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.033803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.034079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.034343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.035003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.045712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 835/1678] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:23.049152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.051740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd374cd-aa7e-4859-b844-96cb019a614e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.080984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd374cd-aa7e-4859-b844-96cb019a614e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.091307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.093199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.093753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.094191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.095282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:23.095750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.098072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.122323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 836/1679] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:23.124752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.140552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a99c2-990b-4875-a285-0e3ebfcc6866 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.147709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.149360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.150175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.151222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.152657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.156321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.289619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 844/1680] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:22 2022] POST /identity/v3/users => generated 297 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:23.294141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.312073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635293-5b49-4dae-a745-02fdce392c34 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.329990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.331273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.331715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.332732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.335117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.340056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.340232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 837/1681] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:23 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:23.341305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.387848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 845/1682] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:23.395011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.418498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa7d0-c334-4123-950d-2101fcd8375e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.507438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbb02c-1b9b-4280-9688-3114f4d7df98 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.524878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.525979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.526576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.527012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.527923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.533035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.568715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.569664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.570115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.570558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] PATH_INFO: `/v3/projects/2db58dceb76c44d68526a0bd03507273/users/26494a89a10648a7b9ca93869e901726/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.606815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db58dceb76c44d68526a0bd03507273, user_id=26494a89a10648a7b9ca93869e901726, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.609602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.709460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 838/1683] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:23 2022] POST /identity/v3/users => generated 290 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:23.714689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.737539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69361c71-813c-4aea-b3ed-cb67187e14cf admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.747213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 846/1684] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:23 2022] PUT /identity/v3/projects/2db58dceb76c44d68526a0bd03507273/users/26494a89a10648a7b9ca93869e901726/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:23.751889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.847194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.847946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.848301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.848653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.849394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.857696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.870063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:23.888424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ddb84-47e9-4ccb-91b6-a513db662c7e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.890257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 839/1685] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:23.891762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.899425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.901915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.906574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.906574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.906574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.908800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.910686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e60c3a-4795-4ebf-bddf-88d60a6e3621 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.917193 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.917883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.918168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.918443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.919327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.921060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.932377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 847/1686] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:23.936791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.956719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e871-e285-4cc5-a815-bb6d3599403a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.960943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 840/1687] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:23.962070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:23.967813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794722b7-154a-4252-9ea6-40c091a54484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.968795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794722b7-154a-4252-9ea6-40c091a54484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.969240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794722b7-154a-4252-9ea6-40c091a54484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.970292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794722b7-154a-4252-9ea6-40c091a54484 admin admin] PATH_INFO: `/v3/projects/2db58dceb76c44d68526a0bd03507273/users/26494a89a10648a7b9ca93869e901726/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:23.975867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794722b7-154a-4252-9ea6-40c091a54484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db58dceb76c44d68526a0bd03507273, user_id=26494a89a10648a7b9ca93869e901726, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:23.986708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794722b7-154a-4252-9ea6-40c091a54484 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:23.988229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0a2cc-eef0-4c96-96f1-f2aa09091970 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:23.996524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:23.997381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:23.998552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:23.999520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] PATH_INFO: `/v3/projects/60aa5d2dc8d04763adc5133d0038f81d/users/86217f43319240f8a15749c543657653/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:24.014910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 848/1688] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:23 2022] PUT /identity/v3/projects/2db58dceb76c44d68526a0bd03507273/users/26494a89a10648a7b9ca93869e901726/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:24.029583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a367916-a345-4b66-a632-cfc61dce74a5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:24.029892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a367916-a345-4b66-a632-cfc61dce74a5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:24.030224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a367916-a345-4b66-a632-cfc61dce74a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:24.046458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60aa5d2dc8d04763adc5133d0038f81d, user_id=86217f43319240f8a15749c543657653, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:24.049678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:24.097228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1a367916-a345-4b66-a632-cfc61dce74a5 None None] MFA Rules not processed for user `26494a89a10648a7b9ca93869e901726`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:24.098816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1a367916-a345-4b66-a632-cfc61dce74a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:24.186661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 841/1689] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:23 2022] PUT /identity/v3/projects/60aa5d2dc8d04763adc5133d0038f81d/users/86217f43319240f8a15749c543657653/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:24.188035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:24.196867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:24.260075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 849/1690] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:24.261430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d3af0-0ea6-4c59-bffa-256229c1a5f4 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:24.261720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d3af0-0ea6-4c59-bffa-256229c1a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:24.261993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d3af0-0ea6-4c59-bffa-256229c1a5f4 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:24.264102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 850/1691] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:47:24.264647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:24.264992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:24.265223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:24.325703 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] MFA Rules not processed for user `86217f43319240f8a15749c543657653`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:24.327105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:24.339894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201466-3097-4389-89fe-d6f6294f1ad2 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:24.347200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:24.347879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:24.348150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:24.348427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] PATH_INFO: `/v3/projects/a2ce10d2cfd34cd18566f28a4d11c44a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:24.350228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ce10d2cfd34cd18566f28a4d11c44a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:24.352877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:24.463459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 851/1692] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:24.467666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:24.477254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:24.528446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ce10d2cfd34cd18566f28a4d11c44a', 'request_id': 'req-e7565cb8-fabf-4335-9270-519e3ea83309'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:24.537122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ce10d2cfd34cd18566f28a4d11c44a', 'request_id': 'req-e7565cb8-fabf-4335-9270-519e3ea83309'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:24.578646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa37d-edd0-4251-a5ce-50510ef8ae98 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:24.637157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ce10d2cfd34cd18566f28a4d11c44a', 'request_id': 'req-e7565cb8-fabf-4335-9270-519e3ea83309'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:24.662186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:24.663024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:24.663541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:24.663954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:24.671118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] The token cache is being invalidate because project a2ce10d2cfd34cd18566f28a4d11c44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:24.671437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:24.674755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e7565cb8-fabf-4335-9270-519e3ea83309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:24.680973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 842/1693] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:24 2022] DELETE /identity/v3/projects/a2ce10d2cfd34cd18566f28a4d11c44a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:24.682494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2008-7301-4d10-9eb1-463f6ebbd386 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:24.682773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2008-7301-4d10-9eb1-463f6ebbd386 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:24.683043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2008-7301-4d10-9eb1-463f6ebbd386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:24.712181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ad9c2008-7301-4d10-9eb1-463f6ebbd386 None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:24.717899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ad9c2008-7301-4d10-9eb1-463f6ebbd386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:24.751457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:24.840152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:24.841659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:24.879261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 852/1694] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:24.887542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:24.983280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 843/1695] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:24.984642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:24.984972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:24.985307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.051070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:25.068893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:25.144184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396738ca-ddcf-42a5-9ba4-c564b3073c53 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:25.162288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:25.162913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:25.165143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:25.165902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.167932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:25.180023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:25.210437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:25.295906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 844/1696] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:25.297230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:25.299462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:25.329827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 853/1697] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:24 2022] POST /identity/v3/projects => generated 379 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:25.329827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:25.340443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:25.381032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a8ec9-ae72-4f5c-b9a4-d80c8786cdb3 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:25.479553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb75d-7aa2-4232-8ed5-4e50c1717765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:25.480277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb75d-7aa2-4232-8ed5-4e50c1717765 service placement] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:25.480812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb75d-7aa2-4232-8ed5-4e50c1717765 service placement] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:25.482020 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb75d-7aa2-4232-8ed5-4e50c1717765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.490658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e858cb-9b3d-4348-84c3-df2343679f09 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:25.497297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb75d-7aa2-4232-8ed5-4e50c1717765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:25.499100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:25.504092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:25.504436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:25.505330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb75d-7aa2-4232-8ed5-4e50c1717765 service placement] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:25.505499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.508574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:25.525956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 845/1698] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:25.529533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0b083-3b4b-4e97-b38b-795a6179d2f7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:25.534172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0b083-3b4b-4e97-b38b-795a6179d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:25.535266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0b083-3b4b-4e97-b38b-795a6179d2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.568507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b1d0b083-3b4b-4e97-b38b-795a6179d2f7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:25.570361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b1d0b083-3b4b-4e97-b38b-795a6179d2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:25.662947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:25.664631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:25.677752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 854/1699] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:25.678414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:25.679959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:25.747582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 846/1700] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:25.752553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0b083-3b4b-4e97-b38b-795a6179d2f7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:25.779533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0b083-3b4b-4e97-b38b-795a6179d2f7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:25.792186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d7ca9-0639-4399-b065-be1f5287ced4 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:25.794476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:25.796743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:25.797045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:25.797314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.799197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:25.799518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:25.803833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:25.808572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:25.809210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:25.809493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:25.813486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.814181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:25.816190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:25.837070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 847/1701] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:25.838335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:25.866041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913510-f729-46d5-9e13-557b4a658d71 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:25.882147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:25.882882 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:25.883122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:25.883421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:25.884119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:25.888504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.012196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 855/1702] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:25 2022] POST /identity/v3/users => generated 296 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:26.016116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.046480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 848/1703] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:25 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:26.051035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.054236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce615-2d8d-4b1d-b8cc-15ca0625aa48 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.200748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.201384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.201667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.202008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.202652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.204298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.212126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90f391-52da-4544-9119-b81901ed6e3d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.231879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.232527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.232886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.233157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.233796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.236969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.238710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 856/1704] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:26.239893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.252586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280051c-5b38-4456-9140-0f204d721523 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.259543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.260302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.260604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.260877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] PATH_INFO: `/v3/projects/574a5de81ed54feaae74e1aa36f05330/users/8d401b2173f44f7f87a14c7f01d18fcd/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.293355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574a5de81ed54feaae74e1aa36f05330, user_id=8d401b2173f44f7f87a14c7f01d18fcd, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.296206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.378339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 849/1705] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:26 2022] POST /identity/v3/users => generated 287 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:26.383210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.408104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 857/1706] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:26 2022] PUT /identity/v3/projects/574a5de81ed54feaae74e1aa36f05330/users/8d401b2173f44f7f87a14c7f01d18fcd/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:26.409941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.416575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6baab-057f-4034-9223-4cf4b45d713e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.531438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2a2a1-b15f-4643-87d2-fce591a35d68 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.549307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.554839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.563596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.563883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.567468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.572847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.612046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 858/1707] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:26.614145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.618856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.619034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:26.619526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.619806 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.620076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.623232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.627320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.655296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870af91-9df5-4d2a-abb5-3b26efbe101b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.655587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.656088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.656376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.656653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] PATH_INFO: `/v3/users/cc11739c0ba74a319fecdd1ba015f3f2` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.658618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc11739c0ba74a319fecdd1ba015f3f2)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.670213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.670514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 850/1708] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:26.671581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.693378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e501f92-edf8-47c6-8052-67ef7e710695 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.704606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.705347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.705634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.705925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] PATH_INFO: `/v3/projects/574a5de81ed54feaae74e1aa36f05330/users/8d401b2173f44f7f87a14c7f01d18fcd/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.708015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574a5de81ed54feaae74e1aa36f05330, user_id=8d401b2173f44f7f87a14c7f01d18fcd, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.719103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.742792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 851/1709] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:26 2022] PUT /identity/v3/projects/574a5de81ed54feaae74e1aa36f05330/users/8d401b2173f44f7f87a14c7f01d18fcd/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:26.743760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:26.872786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfe400-7f01-4475-8c9f-1c5f209cc5c7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:26.879496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5188c09-8f8c-43e6-9f11-eddd8758bcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:26.880138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188c09-8f8c-43e6-9f11-eddd8758bcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.880551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188c09-8f8c-43e6-9f11-eddd8758bcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.880893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5188c09-8f8c-43e6-9f11-eddd8758bcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.881656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5188c09-8f8c-43e6-9f11-eddd8758bcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:26.884028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5188c09-8f8c-43e6-9f11-eddd8758bcd9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:26.896363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 852/1710] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:26.896363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f310bf-ec2b-46ec-a32f-8e272cbac46c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:26.896363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f310bf-ec2b-46ec-a32f-8e272cbac46c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:26.896363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f310bf-ec2b-46ec-a32f-8e272cbac46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:26.965354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-26f310bf-ec2b-46ec-a32f-8e272cbac46c None None] MFA Rules not processed for user `8d401b2173f44f7f87a14c7f01d18fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:26.968347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-26f310bf-ec2b-46ec-a32f-8e272cbac46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:26.977545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:27.011105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc11739c0ba74a319fecdd1ba015f3f2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.013941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc11739c0ba74a319fecdd1ba015f3f2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.031140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc11739c0ba74a319fecdd1ba015f3f2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.098576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 853/1711] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:27.103567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cdc2-7820-4432-9dea-dc81c81560b8 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:27.103567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cdc2-7820-4432-9dea-dc81c81560b8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:27.103567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cdc2-7820-4432-9dea-dc81c81560b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:27.149523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-56f8cdc2-7820-4432-9dea-dc81c81560b8 None None] MFA Rules not processed for user `90c1309ba78a46f0b3a4cd67c4c89542`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:27.151053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-56f8cdc2-7820-4432-9dea-dc81c81560b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:27.179569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc11739c0ba74a319fecdd1ba015f3f2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.220333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc11739c0ba74a319fecdd1ba015f3f2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.230389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 859/1712] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:26 2022] DELETE /identity/v3/users/cc11739c0ba74a319fecdd1ba015f3f2 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:27.230389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:27.232534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:27.239726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 854/1713] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:27.239726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cdc2-7820-4432-9dea-dc81c81560b8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:27.258756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cdc2-7820-4432-9dea-dc81c81560b8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:27.372123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02158-c01e-4a0b-8b9f-8d94a59cb269 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:27.389300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:27.389300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:27.389300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:27.391179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] PATH_INFO: `/v3/users/2e85cf38dca74e4eb8eb1f3523d8e471` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:27.392954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e85cf38dca74e4eb8eb1f3523d8e471)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:27.394239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec146d-e606-4487-bfb6-32f708ab45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:27.395035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec146d-e606-4487-bfb6-32f708ab45e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:27.395704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec146d-e606-4487-bfb6-32f708ab45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:27.395997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec146d-e606-4487-bfb6-32f708ab45e1 admin admin] PATH_INFO: `/v3/projects/511c6489733c4a09b6ecfaaec22a6881/users/97c3ca99afa945f09dbd027478168186/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:27.398140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:27.433591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec146d-e606-4487-bfb6-32f708ab45e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511c6489733c4a09b6ecfaaec22a6881, user_id=97c3ca99afa945f09dbd027478168186, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:27.436396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec146d-e606-4487-bfb6-32f708ab45e1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:27.519728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 855/1714] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:27 2022] PUT /identity/v3/projects/511c6489733c4a09b6ecfaaec22a6881/users/97c3ca99afa945f09dbd027478168186/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:27.528928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:27.528928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:27.528928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:27.593836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] MFA Rules not processed for user `ca168b3b94bb4e7584390e84f4d3de42`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:27.595375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:27.631481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:27.687609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e85cf38dca74e4eb8eb1f3523d8e471'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.693296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e85cf38dca74e4eb8eb1f3523d8e471'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.716926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e85cf38dca74e4eb8eb1f3523d8e471'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.769090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 856/1715] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:27.770192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:27.773054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:27.848784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e85cf38dca74e4eb8eb1f3523d8e471'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.872001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-eca9e876-6a53-43ef-88fc-07e0b5783789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e85cf38dca74e4eb8eb1f3523d8e471'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:27.883201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0915ac-a0f6-4633-8da8-da01273c5d8e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:27.887387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:27.888009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:27.888281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:27.888551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:27.889639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 860/1716] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:27 2022] DELETE /identity/v3/users/2e85cf38dca74e4eb8eb1f3523d8e471 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:27.891013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa0f8-aff0-48c8-acb8-b00fb0a6fce8 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:27.892388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa0f8-aff0-48c8-acb8-b00fb0a6fce8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:27.894581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:27.906839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aa0f8-aff0-48c8-acb8-b00fb0a6fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:27.975907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-254aa0f8-aff0-48c8-acb8-b00fb0a6fce8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:27.982347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:27.982890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-254aa0f8-aff0-48c8-acb8-b00fb0a6fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:27.984055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:27.997535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 857/1717] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:28.023850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:28.036595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.163528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 861/1718] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:28.166361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c76ad3-614a-472d-a143-c20651f098df None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:28.168934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c76ad3-614a-472d-a143-c20651f098df None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:28.169324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c76ad3-614a-472d-a143-c20651f098df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:28.259143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e2c76ad3-614a-472d-a143-c20651f098df None None] MFA Rules not processed for user `97c3ca99afa945f09dbd027478168186`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:28.259143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e2c76ad3-614a-472d-a143-c20651f098df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.286001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2c838-94d2-43e5-9d07-6ba2fd6a8991 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:28.370520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 862/1719] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:28.370979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:28.371316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:28.388159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:28.388296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:28.388296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:28.388296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:28.388296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:28.388572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.402151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] MFA Rules not processed for user `ca168b3b94bb4e7584390e84f4d3de42`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:28.404013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.508691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 863/1720] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:28.509453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:28.511348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.574778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:28.576612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:28.590386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178c6c0-7c2e-4394-9cfe-95b2a58063aa None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:28.594860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:28.595263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 858/1721] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:28.596120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:28.602800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.607598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:28.608201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:28.609786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:28.626808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77876a-69fd-44cd-aa6b-a7cc04017a6b service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:28.633758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:28.635449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:28.639925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:28.640686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:28.641602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:28.642026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] PATH_INFO: `/v3/projects/056c9795dd1f4c12b0b0ea7bc3acd981` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:28.647932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=056c9795dd1f4c12b0b0ea7bc3acd981)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:28.647932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:28.667226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 864/1722] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:28.668581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:28.670164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.709393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84de3e1-0398-4fa0-8d25-af7e440a2290 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:28.724513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:28.725236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:28.725589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:28.726037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:28.727358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:28.729880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:28.831618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056c9795dd1f4c12b0b0ea7bc3acd981', 'request_id': 'req-758bad3b-1245-40bc-983b-5369681aec60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:28.853314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056c9795dd1f4c12b0b0ea7bc3acd981', 'request_id': 'req-758bad3b-1245-40bc-983b-5369681aec60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:28.887772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 865/1723] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:28 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:28.888850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:28.896101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:28.956213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056c9795dd1f4c12b0b0ea7bc3acd981', 'request_id': 'req-758bad3b-1245-40bc-983b-5369681aec60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:28.972098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] The token cache is being invalidate because project 056c9795dd1f4c12b0b0ea7bc3acd981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:28.974094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:28.975143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:28.978222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 859/1724] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:28 2022] DELETE /identity/v3/projects/056c9795dd1f4c12b0b0ea7bc3acd981 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:28.980188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:28.989674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:29.033008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742bed4-cef7-446e-ad36-71bfa43601d7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:29.038118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:29.038915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:29.039385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:29.039791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:29.041773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:29.175433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bad3b-1245-40bc-983b-5369681aec60 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:29.179560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:29.182256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:29.207772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 866/1725] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:29.211286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:29.212730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:29.342707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30954996-e388-42bc-9f48-53f127a4aa49 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:29.355727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:29.357548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:29.357955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:29.358682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:29.360253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:29.362607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:29.388614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c853-d137-4af8-a0c1-4f816138845a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:29.389815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c853-d137-4af8-a0c1-4f816138845a service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:29.390101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c853-d137-4af8-a0c1-4f816138845a service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:29.390376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c853-d137-4af8-a0c1-4f816138845a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:29.403896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2482c853-d137-4af8-a0c1-4f816138845a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:29.414535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:29.487465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 867/1726] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:29 2022] POST /identity/v3/users => generated 295 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:29.487465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:29.504494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:29.568828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:29.570881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c88181-74eb-4258-b7f6-334a50dbc2fe admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:29.590315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:29.592447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:29.593774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:29.595304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] PATH_INFO: `/v3/users/3e4b0dac1e584f0e878f0d80fd04acbb` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:29.598874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4b0dac1e584f0e878f0d80fd04acbb)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:29.616892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c853-d137-4af8-a0c1-4f816138845a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:29.619637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c853-d137-4af8-a0c1-4f816138845a service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:29.619935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:29.636533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 860/1727] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:29.637919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9c0eb-d8af-45fa-97eb-5284ffef09a6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:29.638512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9c0eb-d8af-45fa-97eb-5284ffef09a6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:29.638795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9c0eb-d8af-45fa-97eb-5284ffef09a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:29.683478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-69c9c0eb-d8af-45fa-97eb-5284ffef09a6 None None] MFA Rules not processed for user `1500bceab76f41c5b3e69e1cf55117aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:29.684616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-69c9c0eb-d8af-45fa-97eb-5284ffef09a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:29.843493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 861/1728] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:29.845183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9c0eb-d8af-45fa-97eb-5284ffef09a6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:29.880158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9c0eb-d8af-45fa-97eb-5284ffef09a6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:29.909124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:29.909124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:29.909124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:29.909124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:29.909575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:29.909575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:29.928229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4b0dac1e584f0e878f0d80fd04acbb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:29.929071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4b0dac1e584f0e878f0d80fd04acbb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:29.944660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4b0dac1e584f0e878f0d80fd04acbb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:29.956431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 862/1729] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:29.957308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:29.968857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:29.988232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84eeed-8c93-4543-85af-d1b8d123c425 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:30.005531 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:30.006191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.006596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.006884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] PATH_INFO: `/v3/projects/cf3d1806e48f4adaa2072a6c5df8a3ae` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.008174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3d1806e48f4adaa2072a6c5df8a3ae)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:30.010170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:30.026896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4b0dac1e584f0e878f0d80fd04acbb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:30.064871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4b0dac1e584f0e878f0d80fd04acbb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:30.076777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 868/1730] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:29 2022] DELETE /identity/v3/users/3e4b0dac1e584f0e878f0d80fd04acbb => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:30.077868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:30.081199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:30.206661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3d1806e48f4adaa2072a6c5df8a3ae', 'request_id': 'req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:30.213654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3d1806e48f4adaa2072a6c5df8a3ae', 'request_id': 'req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:30.260277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423ef27-6f03-4f52-8ea8-cc6172545e1a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:30.288462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3d1806e48f4adaa2072a6c5df8a3ae', 'request_id': 'req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:30.305983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] The token cache is being invalidate because project cf3d1806e48f4adaa2072a6c5df8a3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:30.306716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:30.308312 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:30.310579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 863/1731] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:29 2022] DELETE /identity/v3/projects/cf3d1806e48f4adaa2072a6c5df8a3ae => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:30.311532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:30.321169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:30.419768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02732406-205c-447d-9377-91ed8b4b34be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:30.420399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732406-205c-447d-9377-91ed8b4b34be service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.420682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732406-205c-447d-9377-91ed8b4b34be service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.420958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732406-205c-447d-9377-91ed8b4b34be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.424515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-02732406-205c-447d-9377-91ed8b4b34be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:30.494444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e8e7-7f5f-45cb-a1ca-9a2240e51cc0 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:30.508543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:30.509029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.509418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.509696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] PATH_INFO: `/v3/projects/7a3d56bc487b4777b8ef7eacaa2c7271/users/7b077d21598d4b688f0b2e961e2a3951/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.548436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3d56bc487b4777b8ef7eacaa2c7271, user_id=7b077d21598d4b688f0b2e961e2a3951, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:30.553734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:30.556043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02732406-205c-447d-9377-91ed8b4b34be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:30.557919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02732406-205c-447d-9377-91ed8b4b34be service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:30.584832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 869/1732] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:30.591015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c77f-f8ca-4888-8a01-8df3747332e0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.591470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c77f-f8ca-4888-8a01-8df3747332e0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.591844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13c77f-f8ca-4888-8a01-8df3747332e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.654148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 864/1733] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:30 2022] PUT /identity/v3/projects/7a3d56bc487b4777b8ef7eacaa2c7271/users/7b077d21598d4b688f0b2e961e2a3951/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:30.655281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:30.701601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9f13c77f-f8ca-4888-8a01-8df3747332e0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:30.702970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9f13c77f-f8ca-4888-8a01-8df3747332e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:30.822757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d439d4-b592-4862-983e-045d7416ccb4 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:30.829720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bdb34-3611-4308-bc89-06b0571a4612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:30.830843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bdb34-3611-4308-bc89-06b0571a4612 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.834777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bdb34-3611-4308-bc89-06b0571a4612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.834777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bdb34-3611-4308-bc89-06b0571a4612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.834777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bdb34-3611-4308-bc89-06b0571a4612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:30.834777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bdb34-3611-4308-bc89-06b0571a4612 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:30.848428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 865/1734] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:30.850079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664477-5a25-4a04-be24-b7f5dc3c90df None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.850844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664477-5a25-4a04-be24-b7f5dc3c90df None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.851564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664477-5a25-4a04-be24-b7f5dc3c90df None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.861433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 866/1735] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 1 16:47:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:47:30.862406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664477-5a25-4a04-be24-b7f5dc3c90df None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:30.865238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-80664477-5a25-4a04-be24-b7f5dc3c90df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:30.876741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 870/1736] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:30.878314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13c77f-f8ca-4888-8a01-8df3747332e0 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:30.901922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13c77f-f8ca-4888-8a01-8df3747332e0 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:30.908717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40bcc-ea72-42d7-9201-9535323a41ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:30.909677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40bcc-ea72-42d7-9201-9535323a41ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.910153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40bcc-ea72-42d7-9201-9535323a41ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.910949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40bcc-ea72-42d7-9201-9535323a41ff admin admin] PATH_INFO: `/v3/projects/7a3d56bc487b4777b8ef7eacaa2c7271/users/7b077d21598d4b688f0b2e961e2a3951/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.919078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40bcc-ea72-42d7-9201-9535323a41ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3d56bc487b4777b8ef7eacaa2c7271, user_id=7b077d21598d4b688f0b2e961e2a3951, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:30.921978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664477-5a25-4a04-be24-b7f5dc3c90df None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:30.923394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc40bcc-ea72-42d7-9201-9535323a41ff admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:30.943582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:30.946313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.946618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.946900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] PATH_INFO: `/v3/projects/ab688a0e2e10438580dae575528c884b` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.951102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 871/1737] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:30 2022] PUT /identity/v3/projects/7a3d56bc487b4777b8ef7eacaa2c7271/users/7b077d21598d4b688f0b2e961e2a3951/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:30.952296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850fdff-de47-436a-910a-1c3bb648dc0e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:30.952750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850fdff-de47-436a-910a-1c3bb648dc0e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:30.953167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850fdff-de47-436a-910a-1c3bb648dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:30.953624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab688a0e2e10438580dae575528c884b)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:30.958987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:31.016464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8850fdff-de47-436a-910a-1c3bb648dc0e None None] MFA Rules not processed for user `94c7e57c93dd49a1a3e784002ae94fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:31.020524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8850fdff-de47-436a-910a-1c3bb648dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.145816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 872/1738] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:47:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:31.146998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab688a0e2e10438580dae575528c884b', 'request_id': 'req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.147928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:31.148371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:31.148647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:31.163081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab688a0e2e10438580dae575528c884b', 'request_id': 'req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.195980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:31.197250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.294257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab688a0e2e10438580dae575528c884b', 'request_id': 'req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.313680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] The token cache is being invalidate because project ab688a0e2e10438580dae575528c884b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:31.313977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.322104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14ec55b8-d2c3-4a03-a9e6-6715450fd9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.334372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 867/1739] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:30 2022] DELETE /identity/v3/projects/ab688a0e2e10438580dae575528c884b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:31.340062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:31.340365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:31.340647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:31.369889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 873/1740] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:31.369889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:31.370791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.380096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:31.417088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] MFA Rules not processed for user `7b077d21598d4b688f0b2e961e2a3951`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:31.418418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.578271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c714-6168-4126-aa22-225ac0f25ec5 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:31.587895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 868/1741] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:31.587895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:31.589107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.590456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714874a1-e501-4c59-9ff0-d2d503ff5000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:31.591050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714874a1-e501-4c59-9ff0-d2d503ff5000 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:31.591312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714874a1-e501-4c59-9ff0-d2d503ff5000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:31.591583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714874a1-e501-4c59-9ff0-d2d503ff5000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:31.593308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-714874a1-e501-4c59-9ff0-d2d503ff5000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.613837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714874a1-e501-4c59-9ff0-d2d503ff5000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:31.615480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714874a1-e501-4c59-9ff0-d2d503ff5000 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:31.629869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 874/1742] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:31.631364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6122-592f-4e5c-933d-2f45cff77c8e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:31.631649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6122-592f-4e5c-933d-2f45cff77c8e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:31.631918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6122-592f-4e5c-933d-2f45cff77c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:31.634729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11444de-3e29-4cc3-8e4f-7fa1e75af725 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:31.646307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:31.647270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:31.647693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:31.648931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] PATH_INFO: `/v3/users/5b537d46a7ed4838b3645c0a8ebdf044` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:31.660104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b537d46a7ed4838b3645c0a8ebdf044)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:31.660104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:31.698912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b07b6122-592f-4e5c-933d-2f45cff77c8e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:31.700237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b07b6122-592f-4e5c-933d-2f45cff77c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.724945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 875/1743] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:31.731492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b6122-592f-4e5c-933d-2f45cff77c8e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:31.745833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b6122-592f-4e5c-933d-2f45cff77c8e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:31.752580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:31.753425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:31.759419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:31.759419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:31.759419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:31.759419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:31.759419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:31.770924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 876/1744] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:31.772234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:31.774318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.846532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539cbec-db9b-4a1b-af5c-39fe2340ddf7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:31.854031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a491e-8ea8-4fd4-98be-58c8ef14c4f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:31.854948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a491e-8ea8-4fd4-98be-58c8ef14c4f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:31.856777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a491e-8ea8-4fd4-98be-58c8ef14c4f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:31.857234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a491e-8ea8-4fd4-98be-58c8ef14c4f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:31.862603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fd9a491e-8ea8-4fd4-98be-58c8ef14c4f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:31.916548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b537d46a7ed4838b3645c0a8ebdf044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.955659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b537d46a7ed4838b3645c0a8ebdf044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.972506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b537d46a7ed4838b3645c0a8ebdf044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.975335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b537d46a7ed4838b3645c0a8ebdf044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.977100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b537d46a7ed4838b3645c0a8ebdf044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:31.996052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a491e-8ea8-4fd4-98be-58c8ef14c4f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:31.998120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a491e-8ea8-4fd4-98be-58c8ef14c4f4 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.010941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 877/1745] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:32.013172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.013580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.013920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.042431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:32.043805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:32.061810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 878/1746] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:32.063076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.064997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:32.084201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8904f24-0d08-4967-9791-3cf0b3b63c9e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.094839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc579b-db81-44de-8c68-f20bcb65eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.095754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc579b-db81-44de-8c68-f20bcb65eaed admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.099190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc579b-db81-44de-8c68-f20bcb65eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.099190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc579b-db81-44de-8c68-f20bcb65eaed admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.099190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc579b-db81-44de-8c68-f20bcb65eaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.102929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc579b-db81-44de-8c68-f20bcb65eaed admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.149377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 869/1747] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:31 2022] DELETE /identity/v3/users/5b537d46a7ed4838b3645c0a8ebdf044 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:32.150231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.246009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 879/1748] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:32 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:32.252771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602477d-69ed-416e-ac4a-30c3f921b17a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.253828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602477d-69ed-416e-ac4a-30c3f921b17a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.255324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602477d-69ed-416e-ac4a-30c3f921b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.272431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fb6de-769c-42a9-b07c-1cc94823f303 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.314391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1602477d-69ed-416e-ac4a-30c3f921b17a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:32.314391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1602477d-69ed-416e-ac4a-30c3f921b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:32.368423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:32.375537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.378024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.378024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.378024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.378024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:32.378500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.380692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.400383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 870/1749] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:32.400383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.411068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3548-01ea-488c-8eee-de636928b16e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.414751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 880/1750] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:32.415887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602477d-69ed-416e-ac4a-30c3f921b17a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.436408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.437040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.437322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.437596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.438274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.440285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.442830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602477d-69ed-416e-ac4a-30c3f921b17a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.455513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.457300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.457722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.458006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.464567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.468041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.543565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 871/1751] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:32 2022] POST /identity/v3/users => generated 279 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:32.544422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.550234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:32.569174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 881/1752] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:32 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:32.572903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.682366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3f547-a2d0-4713-9824-21db033a9e9b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.727544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d725828-f063-45b5-a180-7ed2d96c979b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.733352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.734135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.738556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.738556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.738556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.738556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.749497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 882/1753] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:32.751040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.765213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada43c-3536-4edd-b97d-df456cbf59c9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.769765 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.770450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.770776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.771051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.771760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.773807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.830418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.831656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.832208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.832751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.873202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:32.876186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.882909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.882992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 883/1754] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:32 2022] POST /identity/v3/users => generated 282 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:32.882992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.886300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:32.911344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 872/1755] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:32.912325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.924211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20acf38-f768-4efc-ae92-1bb7040f4d84 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.929772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.930823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.931673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.933235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.934275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.936146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.948540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 873/1756] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:32.949773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.961454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4194-3792-4ff7-a916-a0ae12eee2b8 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.967512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.969228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.969228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.969228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.969458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:32.970922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:32.977641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee22ac0-4dc3-4e77-8684-ae8224c48813 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:32.981652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 874/1757] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:32.982465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:32.988442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:32.989089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:32.989425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:32.989703 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:32.995551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:33.001682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866056c3-5bad-4959-981e-353191c16334 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:33.010230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:33.010765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b316-197d-4c70-80eb-3450778c6650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:33.011930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:33.012460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b316-197d-4c70-80eb-3450778c6650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:33.012869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b316-197d-4c70-80eb-3450778c6650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:33.013297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b316-197d-4c70-80eb-3450778c6650 admin admin] PATH_INFO: `/v3/projects/da78547ac93b43df996befd5da0dedfe/users/34cfd87a7d7f49fca5a681de833a20b8/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:33.025629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 884/1758] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:33.026512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:33.036996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b316-197d-4c70-80eb-3450778c6650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da78547ac93b43df996befd5da0dedfe, user_id=34cfd87a7d7f49fca5a681de833a20b8, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:33.038580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f79b39-29e1-41e6-872a-9869f6ce7bbb service placement] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:33.042058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b316-197d-4c70-80eb-3450778c6650 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:33.045471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:33.046140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:33.046423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:33.046700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:33.048641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:33.050627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:33.066095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 885/1759] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:33.067182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:33.098155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797bce4-4ea1-42c9-9d54-3f24e8b9fc56 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:33.114337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe73546-7ac6-4bbd-8ee3-7853afabf1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:33.116700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73546-7ac6-4bbd-8ee3-7853afabf1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:33.124364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73546-7ac6-4bbd-8ee3-7853afabf1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:33.124782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 875/1760] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:32 2022] PUT /identity/v3/projects/da78547ac93b43df996befd5da0dedfe/users/34cfd87a7d7f49fca5a681de833a20b8/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:33.124890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73546-7ac6-4bbd-8ee3-7853afabf1f8 admin admin] PATH_INFO: `/v3/projects/f14f328081484b82ab1633a6e64092aa/users/e0529a0ecae447f0b621757abfc0968a/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:33.138378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915a1b-2a30-4379-adb1-89b835c5f9f5 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:33.138862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915a1b-2a30-4379-adb1-89b835c5f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:33.139335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915a1b-2a30-4379-adb1-89b835c5f9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:33.182466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe73546-7ac6-4bbd-8ee3-7853afabf1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14f328081484b82ab1633a6e64092aa, user_id=e0529a0ecae447f0b621757abfc0968a, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:33.197118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe73546-7ac6-4bbd-8ee3-7853afabf1f8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:33.246355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9b915a1b-2a30-4379-adb1-89b835c5f9f5 None None] MFA Rules not processed for user `34cfd87a7d7f49fca5a681de833a20b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:33.248451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9b915a1b-2a30-4379-adb1-89b835c5f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:33.324777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 886/1761] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:33 2022] PUT /identity/v3/projects/f14f328081484b82ab1633a6e64092aa/users/e0529a0ecae447f0b621757abfc0968a/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:33.336343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1bfd6-ed04-4d16-a028-377043fde66f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:33.336627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1bfd6-ed04-4d16-a028-377043fde66f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:33.337023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1bfd6-ed04-4d16-a028-377043fde66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:33.401513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-17b1bfd6-ed04-4d16-a028-377043fde66f None None] MFA Rules not processed for user `e0529a0ecae447f0b621757abfc0968a`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:33.401919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-17b1bfd6-ed04-4d16-a028-377043fde66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:33.460122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 876/1762] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:33.464584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b915a1b-2a30-4379-adb1-89b835c5f9f5 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:33.530258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 887/1763] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:33.535989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1bfd6-ed04-4d16-a028-377043fde66f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:33.624818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1bfd6-ed04-4d16-a028-377043fde66f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:33.633677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:33.635633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:33.639717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:33.639717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:33.639717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:33.642861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:33.680831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b915a1b-2a30-4379-adb1-89b835c5f9f5 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:33.686135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:33.686887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:33.687186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:33.687643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:33.688367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:33.690763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:33.892548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:33.896671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 877/1764] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:33 2022] POST /identity/v3/projects => generated 357 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:33.900029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 888/1765] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:33 2022] POST /identity/v3/projects => generated 365 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:33.902147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:33.905559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.060411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034baa00-3124-4520-938c-69356ab44865 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:34.065721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96c8e5-fb26-445a-86fc-d7c0f69e2b31 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:34.067035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:34.068234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.068745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.069442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.070418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:34.072924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:34.077099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:34.077613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.077896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.078272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.078922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:34.093412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:34.185278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 878/1766] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:33 2022] POST /identity/v3/users => generated 285 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:34.187980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.189444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:34.218132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f382a-5578-4159-88fb-e1bd07e4f551 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:34.224037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:34.225238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.225667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.226086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] PATH_INFO: `/v3/projects/9c2090efd502489cb6ae7b6280cb21b0` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.229632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2090efd502489cb6ae7b6280cb21b0)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:34.231643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:34.244924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 889/1767] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:33 2022] POST /identity/v3/users => generated 289 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:34.245778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.262991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638371-da94-4276-9dff-a31f81e9d84f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:34.317928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:34.318137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.318458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.341849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.342652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:34.361823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:34.394201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 890/1768] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:34.395213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.417248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5292-24c6-4548-a474-6a82b54a7b73 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:34.430611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b295-97f4-46ad-af3e-127d10f6c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:34.431133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b295-97f4-46ad-af3e-127d10f6c4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.431444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b295-97f4-46ad-af3e-127d10f6c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.431712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b295-97f4-46ad-af3e-127d10f6c4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.434597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b295-97f4-46ad-af3e-127d10f6c4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:34.434988 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b295-97f4-46ad-af3e-127d10f6c4dc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:34.470753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 891/1769] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:34.470753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251470-0b3f-445f-b041-8b8622742b84 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.470753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251470-0b3f-445f-b041-8b8622742b84 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.470753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251470-0b3f-445f-b041-8b8622742b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.509012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b6251470-0b3f-445f-b041-8b8622742b84 None None] MFA Rules not processed for user `90c1309ba78a46f0b3a4cd67c4c89542`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:34.514892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b6251470-0b3f-445f-b041-8b8622742b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:34.550865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2090efd502489cb6ae7b6280cb21b0', 'request_id': 'req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:34.577420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2090efd502489cb6ae7b6280cb21b0', 'request_id': 'req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:34.620456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 892/1770] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:34.621373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6251470-0b3f-445f-b041-8b8622742b84 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.672290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2090efd502489cb6ae7b6280cb21b0', 'request_id': 'req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:34.685734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] The token cache is being invalidate because project 9c2090efd502489cb6ae7b6280cb21b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:34.690250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:34.691265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:34.696047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 879/1771] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:34 2022] DELETE /identity/v3/projects/9c2090efd502489cb6ae7b6280cb21b0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:34.696047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.699096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:34.712505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6251470-0b3f-445f-b041-8b8622742b84 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:34.722886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:34.723737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.724014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.724285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] PATH_INFO: `/v3/projects/61ae6690fa4b4f478b7c1b63dc941ff5/users/8e338a0b0481409eb4ae1caa73648f6d/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.738338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4ec9c-4d3e-44d9-9776-b5aa36b62848 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:34.744138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:34.744925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:34.745416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:34.746064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] PATH_INFO: `/v3/projects/8b0b93a6276241a58dc6203cc9263548/users/ad6bfff5a85c4178879b12260d20dbf3/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:34.771534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0b93a6276241a58dc6203cc9263548, user_id=ad6bfff5a85c4178879b12260d20dbf3, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:34.778492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ae6690fa4b4f478b7c1b63dc941ff5, user_id=8e338a0b0481409eb4ae1caa73648f6d, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:34.781218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:34.785917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:34.983757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 893/1772] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:34 2022] PUT /identity/v3/projects/61ae6690fa4b4f478b7c1b63dc941ff5/users/8e338a0b0481409eb4ae1caa73648f6d/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:34.983911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 880/1773] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:34 2022] PUT /identity/v3/projects/8b0b93a6276241a58dc6203cc9263548/users/ad6bfff5a85c4178879b12260d20dbf3/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:34.984022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.984124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:34.984124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:34.985298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:35.098567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:35.117357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1be9d5-d365-4561-aa30-502db77b7127 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:35.143856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:35.164101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.165905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.166488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.168550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:35.175467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:35.202405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 881/1774] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:35.207318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:35.209615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7649c8-95dc-4522-a754-907985611f6e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:35.216819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:35.218133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.218903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.219525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] PATH_INFO: `/v3/users/26494a89a10648a7b9ca93869e901726` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.221434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26494a89a10648a7b9ca93869e901726)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:35.224611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:35.234061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c14a6-6ca7-43f7-b0f7-b2ffc1c20bfa admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:35.239259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:35.239922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.240369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.240777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.241708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:35.243956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:35.272482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 882/1775] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:35.273507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:35.311780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511ee6-8e55-4d1f-a639-8f769a157460 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:35.321335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:35.323285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.325098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.325708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] PATH_INFO: `/v3/projects/61ae6690fa4b4f478b7c1b63dc941ff5/users/8e338a0b0481409eb4ae1caa73648f6d/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.329073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ae6690fa4b4f478b7c1b63dc941ff5, user_id=8e338a0b0481409eb4ae1caa73648f6d, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:35.340345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:35.384038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 883/1776] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:35 2022] PUT /identity/v3/projects/61ae6690fa4b4f478b7c1b63dc941ff5/users/8e338a0b0481409eb4ae1caa73648f6d/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:35.385102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:35.500919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26494a89a10648a7b9ca93869e901726'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:35.502561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3a491-15f2-447a-94fc-e7f6fa687eb8 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:35.509539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26494a89a10648a7b9ca93869e901726'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:35.518854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2479-85a7-4be8-be27-9205f7828539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:35.519805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2479-85a7-4be8-be27-9205f7828539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.520113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2479-85a7-4be8-be27-9205f7828539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.520373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2479-85a7-4be8-be27-9205f7828539 admin admin] PATH_INFO: `/v3/projects/8b0b93a6276241a58dc6203cc9263548/users/ad6bfff5a85c4178879b12260d20dbf3/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.525075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2479-85a7-4be8-be27-9205f7828539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0b93a6276241a58dc6203cc9263548, user_id=ad6bfff5a85c4178879b12260d20dbf3, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:35.528432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2479-85a7-4be8-be27-9205f7828539 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:35.531850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26494a89a10648a7b9ca93869e901726'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:35.562582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 884/1777] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:35 2022] PUT /identity/v3/projects/8b0b93a6276241a58dc6203cc9263548/users/ad6bfff5a85c4178879b12260d20dbf3/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:35.562582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe36d73-0cd1-4bb7-a933-ba5cf0f6e77d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.562582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe36d73-0cd1-4bb7-a933-ba5cf0f6e77d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.562582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe36d73-0cd1-4bb7-a933-ba5cf0f6e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.595900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0fe36d73-0cd1-4bb7-a933-ba5cf0f6e77d None None] MFA Rules not processed for user `1500bceab76f41c5b3e69e1cf55117aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:35.597010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0fe36d73-0cd1-4bb7-a933-ba5cf0f6e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:35.689721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26494a89a10648a7b9ca93869e901726'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:35.704920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-5d24729f-ec81-4363-ac08-e4f5e11a8f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26494a89a10648a7b9ca93869e901726'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:35.714186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 885/1778] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:35.714186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e57e-6b7f-4b80-8d96-bf6fec694582 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.714186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e57e-6b7f-4b80-8d96-bf6fec694582 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.714186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e57e-6b7f-4b80-8d96-bf6fec694582 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.714186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 886/1779] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 1 16:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:47:35.714186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.714186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.715081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.718451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 894/1780] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:34 2022] DELETE /identity/v3/users/26494a89a10648a7b9ca93869e901726 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:35.720082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2917e-16aa-4ee1-9819-355e97b28677 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.720386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2917e-16aa-4ee1-9819-355e97b28677 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.720673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2917e-16aa-4ee1-9819-355e97b28677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.753895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] MFA Rules not processed for user `8e338a0b0481409eb4ae1caa73648f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:35.754686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-7ed2917e-16aa-4ee1-9819-355e97b28677 None None] MFA Rules not processed for user `ad6bfff5a85c4178879b12260d20dbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:35.755873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:35.755983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7ed2917e-16aa-4ee1-9819-355e97b28677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:35.791548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:35.862546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 895/1781] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:35.863635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 887/1782] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:35.864398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.864826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.865380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:35.886204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] MFA Rules not processed for user `94c7e57c93dd49a1a3e784002ae94fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:35.887691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:35.959868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 896/1783] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:35.972439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:35.974320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:35.989941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1653e5d-13c9-4597-b9b4-c917fb1dece2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:35.994660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:35.995233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:35.995563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:35.995931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:36.004276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:36.005734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:36.013150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:36.014361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 888/1784] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:36.014740 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:36.094450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111553c-c4be-4942-bbc2-62d3cd2f36cf None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:36.105174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:36.105951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:36.106336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:36.106714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:36.122316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:36.124796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:36.143591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 897/1785] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:36.226865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:36.232328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:36.259015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cfdf-dd76-4346-bdbe-081c9d592346 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:36.275255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:36.275885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:36.276164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:36.276436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:36.295449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:36.296928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:36.309900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 889/1786] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:36.544228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:36.544228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:36.572391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:36.583732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cdcc2-8b65-45a2-bf20-16788e4a735f service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:36.587622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:36.588225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:36.588655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:36.589215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:36.591398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:36.634898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f9190-744a-44e0-99b5-8eca82249983 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:36.641298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:36.641996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:36.642296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:36.642565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] PATH_INFO: `/v3/projects/2db58dceb76c44d68526a0bd03507273` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:36.644519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db58dceb76c44d68526a0bd03507273)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:36.647148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:36.708181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:36.709662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:36.747994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 890/1787] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:36.777235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:36.791772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7f74f-2dc8-44db-abf7-763a0dca7b36 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:36.825931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db58dceb76c44d68526a0bd03507273', 'request_id': 'req-18991328-fd81-432d-8d12-4d3cc5591e4b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:36.842682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db58dceb76c44d68526a0bd03507273', 'request_id': 'req-18991328-fd81-432d-8d12-4d3cc5591e4b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:36.856472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05a2a1-d2fb-4c26-84e2-0f33a814b279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:36.857762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05a2a1-d2fb-4c26-84e2-0f33a814b279 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:36.858772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05a2a1-d2fb-4c26-84e2-0f33a814b279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:36.859110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05a2a1-d2fb-4c26-84e2-0f33a814b279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:36.861883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ea05a2a1-d2fb-4c26-84e2-0f33a814b279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:36.948399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05a2a1-d2fb-4c26-84e2-0f33a814b279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:36.951069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05a2a1-d2fb-4c26-84e2-0f33a814b279 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:36.963703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 891/1788] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:36.973864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db58dceb76c44d68526a0bd03507273', 'request_id': 'req-18991328-fd81-432d-8d12-4d3cc5591e4b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:36.993536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] The token cache is being invalidate because project 2db58dceb76c44d68526a0bd03507273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:36.994061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:36.996675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-18991328-fd81-432d-8d12-4d3cc5591e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:37.009413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 898/1789] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:36 2022] DELETE /identity/v3/projects/2db58dceb76c44d68526a0bd03507273 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:37.011039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bcbf9-352f-4ba1-b082-04a97e4bbd67 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.012061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bcbf9-352f-4ba1-b082-04a97e4bbd67 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.012509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bcbf9-352f-4ba1-b082-04a97e4bbd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.066665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d04bcbf9-352f-4ba1-b082-04a97e4bbd67 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:37.068215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d04bcbf9-352f-4ba1-b082-04a97e4bbd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:37.148000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 892/1790] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:37.155817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49431946-25ec-4875-84a7-73159c88343b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.156039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49431946-25ec-4875-84a7-73159c88343b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.156850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49431946-25ec-4875-84a7-73159c88343b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.178163 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-49431946-25ec-4875-84a7-73159c88343b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:37.179418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-49431946-25ec-4875-84a7-73159c88343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:37.187107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 899/1791] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:37.191367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bcbf9-352f-4ba1-b082-04a97e4bbd67 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:37.200962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bcbf9-352f-4ba1-b082-04a97e4bbd67 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:37.205567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:37.206345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.206630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.206958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.207714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:37.208023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:37.209625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:37.222507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 893/1792] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:37.226907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49431946-25ec-4875-84a7-73159c88343b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:37.236919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49431946-25ec-4875-84a7-73159c88343b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:37.241532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:37.242128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.242405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.242675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.246157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:37.246157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:37.409509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 900/1793] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:37 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:37.411415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:37.429409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f17a3-2f3f-460f-8e20-1a0a34343e40 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:37.504936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:37.506535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.506852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.507092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.507920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:37.510903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:37.591530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:37.608802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 894/1794] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:37 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:47:37.610614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:37.629428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078faf-e19d-429e-8ec6-936c627de007 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:37.635645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:37.636379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.636664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.636937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.637741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:37.639377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:37.666165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 901/1795] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:37.670166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:37.682347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fbbc0-5d7a-4974-90ee-fb06c96da476 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:37.688868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:37.690731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.691241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.691697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.699037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:37.701515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:37.703555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:37.706983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:37.745724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 895/1796] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:37.749867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:37.794327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:37.807342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e912f9-b380-4190-ae7e-ee03afdbd959 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:37.817462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:37.818317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.818755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.819319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] PATH_INFO: `/v3/projects/932d00cd4d6a4c8e8367fd1ef60ba9cb/users/169d4d93a4c04eb5807323ad5eeb0c7e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.845403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7077f-692d-40d4-9992-16296cdbc6b9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:37.849667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932d00cd4d6a4c8e8367fd1ef60ba9cb, user_id=169d4d93a4c04eb5807323ad5eeb0c7e, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:37.852282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ee4f1-3272-4b1d-b4c2-06afcb2cf8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:37.864212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee4f1-3272-4b1d-b4c2-06afcb2cf8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:37.864212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee4f1-3272-4b1d-b4c2-06afcb2cf8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:37.864212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ee4f1-3272-4b1d-b4c2-06afcb2cf8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:37.864525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:37.864613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1f6ee4f1-3272-4b1d-b4c2-06afcb2cf8d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:37.964713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ee4f1-3272-4b1d-b4c2-06afcb2cf8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:37.966506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ee4f1-3272-4b1d-b4c2-06afcb2cf8d4 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:37.993135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 902/1797] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:38.009800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 896/1798] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:37 2022] PUT /identity/v3/projects/932d00cd4d6a4c8e8367fd1ef60ba9cb/users/169d4d93a4c04eb5807323ad5eeb0c7e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:38.022657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9735e-3e5f-4d50-810d-7d9ba2cc6258 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:38.022657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9735e-3e5f-4d50-810d-7d9ba2cc6258 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:38.022657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9735e-3e5f-4d50-810d-7d9ba2cc6258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:38.054003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a9c9735e-3e5f-4d50-810d-7d9ba2cc6258 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:38.055348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a9c9735e-3e5f-4d50-810d-7d9ba2cc6258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:38.144395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 903/1799] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:38.162923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:38.170705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:38.336217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9443e-6ea8-4981-baf0-cfa97c2e5a92 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:38.336302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9443e-6ea8-4981-baf0-cfa97c2e5a92 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:38.336572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9443e-6ea8-4981-baf0-cfa97c2e5a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:38.338363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d72b6-03d1-49f2-8c63-be79ccbeeec1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:38.344753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:38.345597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:38.346017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:38.346429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:38.358297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:38.360426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:38.371101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 897/1800] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:38.426134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-06d9443e-6ea8-4981-baf0-cfa97c2e5a92 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:38.427957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-06d9443e-6ea8-4981-baf0-cfa97c2e5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:38.523299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 904/1801] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:38.915536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:38.916986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:39.035922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc5c3-c04a-4670-b116-c93eac79a304 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:39.040105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:39.041083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:39.041368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:39.041640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:39.051038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:39.052977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:39.061570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 898/1802] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:47:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:47:39.989467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ed546-b651-4b0e-81b8-84c0cbeb0b0f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:39.990009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ed546-b651-4b0e-81b8-84c0cbeb0b0f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:39.990009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ed546-b651-4b0e-81b8-84c0cbeb0b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:40.022198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-eb1ed546-b651-4b0e-81b8-84c0cbeb0b0f None None] MFA Rules not processed for user `94c7e57c93dd49a1a3e784002ae94fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:40.023890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-eb1ed546-b651-4b0e-81b8-84c0cbeb0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:40.031328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 905/1803] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 1 16:47:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:40.113977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:40.129549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0a9b-9790-4393-8737-32c64c64d0bf service swift] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:40.138891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace45c0-6cef-46f9-965e-91544578b81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:40.139818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace45c0-6cef-46f9-965e-91544578b81a service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:40.140309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace45c0-6cef-46f9-965e-91544578b81a service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:40.140750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace45c0-6cef-46f9-965e-91544578b81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:40.149821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace45c0-6cef-46f9-965e-91544578b81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:40.151616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace45c0-6cef-46f9-965e-91544578b81a service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:40.161327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 899/1804] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:41.214856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:41.599283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4b64a-3d6b-4b59-b72d-6c6190cc212a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:41.600504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4b64a-3d6b-4b59-b72d-6c6190cc212a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:41.601542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4b64a-3d6b-4b59-b72d-6c6190cc212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:41.621847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90415d44-028d-443f-a57e-d5f8166cd249 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:41.622456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90415d44-028d-443f-a57e-d5f8166cd249 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:41.623071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90415d44-028d-443f-a57e-d5f8166cd249 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:41.629962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 900/1805] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:47:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:47:41.681424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3ae4b64a-3d6b-4b59-b72d-6c6190cc212a None None] MFA Rules not processed for user `169d4d93a4c04eb5807323ad5eeb0c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:41.681424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3ae4b64a-3d6b-4b59-b72d-6c6190cc212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:41.681677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:41.681677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:41.682241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:41.733625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:41.733625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:41.870233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 906/1806] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:41.874512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4b64a-3d6b-4b59-b72d-6c6190cc212a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:41.891628 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4b64a-3d6b-4b59-b72d-6c6190cc212a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:41.892984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 901/1807] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:47:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:41.901984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:41.904096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:41.907375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:41.907999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:41.908277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:41.908576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:41.909395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:41.911921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:41.926723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba4619-3224-48ca-9672-3196e391f369 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:41.935245 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:41.936926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:41.937407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:41.938223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:41.954304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:41.956415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:41.986151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 902/1808] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:42.085022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:42.091031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 907/1809] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:41 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:42.111682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e545fc-38ab-4222-a1fc-b2953d87afb2 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:42.115066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:42.121277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:42.262771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:42.264701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:42.264701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:42.264701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:42.264957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:42.267301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:42.267785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:42.277048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123fc3-f554-4ecd-9ba3-c8f44dde842a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:42.283331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:42.284028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:42.284300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:42.284574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] PATH_INFO: `/v3/users/e0529a0ecae447f0b621757abfc0968a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:42.285907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0529a0ecae447f0b621757abfc0968a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:42.287878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:42.374529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 903/1810] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:42 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:47:42.376165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:42.389260 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db9ef-87d4-4748-8bb7-70b56ed63f68 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:42.394908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:42.395641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:42.395991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:42.396336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:42.397200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:42.398919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:42.409916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 904/1811] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:42.414898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:42.426254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ac3d-ea58-4405-a238-0745e7269224 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:42.438266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:42.439096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:42.439493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:42.439842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] PATH_INFO: `/v3/projects/f5d43d98c94846de8ec1356b3b1543cd/users/f1094cb45bb14f48883b335ea232a8f7/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:42.457352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d43d98c94846de8ec1356b3b1543cd, user_id=f1094cb45bb14f48883b335ea232a8f7, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:42.460599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:42.502364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0529a0ecae447f0b621757abfc0968a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:42.503045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0529a0ecae447f0b621757abfc0968a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:42.510328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0529a0ecae447f0b621757abfc0968a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:42.577304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 905/1812] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:42 2022] PUT /identity/v3/projects/f5d43d98c94846de8ec1356b3b1543cd/users/f1094cb45bb14f48883b335ea232a8f7/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:42.577304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:42.629701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0529a0ecae447f0b621757abfc0968a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:42.657319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-621da779-0bd9-4c45-b917-531ea7008b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0529a0ecae447f0b621757abfc0968a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:42.668501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 908/1813] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:42 2022] DELETE /identity/v3/users/e0529a0ecae447f0b621757abfc0968a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:42.673277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:42.673558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:42.673886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:42.680563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff486096-9aae-48ae-8a0d-48b57b720ce1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:42.696713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:42.698072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:42.755923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:42.759752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:42.759752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:42.759752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:42.759752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:42.759752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:42.789102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 909/1814] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:42.795627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 906/1815] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:42.799934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:42.801483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:42.804713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:42.822915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b47813-f999-4d1d-b4f7-05278336b566 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:42.823700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:42.826901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:42.828987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:42.829463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:42.829810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] PATH_INFO: `/v3/projects/f5d43d98c94846de8ec1356b3b1543cd/users/f1094cb45bb14f48883b335ea232a8f7/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:42.840663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d43d98c94846de8ec1356b3b1543cd, user_id=f1094cb45bb14f48883b335ea232a8f7, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:42.844665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:42.871253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 910/1816] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:42 2022] PUT /identity/v3/projects/f5d43d98c94846de8ec1356b3b1543cd/users/f1094cb45bb14f48883b335ea232a8f7/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:42.925137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e681214-0eef-4a6c-84d4-60289ad67336 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:43.067471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:43.068378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:43.068848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:43.069281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:43.156562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:43.158276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:43.182171 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 907/1817] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:43.505302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:43.939150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:43.941107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:43.961048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e3e3e-0d2b-4dbf-a4de-b23e2ccd5f26 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:43.979704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:43.980942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:43.981447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:43.981929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] PATH_INFO: `/v3/projects/f14f328081484b82ab1633a6e64092aa` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:43.984592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14f328081484b82ab1633a6e64092aa)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:43.986502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:44.010205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:44.011872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:44.029718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c86d-56df-429e-ba7e-cd633486b370 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:44.043860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:44.044797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:44.045122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:44.045718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] PATH_INFO: `/v3/users/86217f43319240f8a15749c543657653` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:44.047861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=86217f43319240f8a15749c543657653)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:44.051231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:44.217072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14f328081484b82ab1633a6e64092aa', 'request_id': 'req-063b74de-b489-4c8c-8d70-f1aca6a4cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.226388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14f328081484b82ab1633a6e64092aa', 'request_id': 'req-063b74de-b489-4c8c-8d70-f1aca6a4cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.313529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86217f43319240f8a15749c543657653'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.328454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14f328081484b82ab1633a6e64092aa', 'request_id': 'req-063b74de-b489-4c8c-8d70-f1aca6a4cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.338794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86217f43319240f8a15749c543657653'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.342441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] The token cache is being invalidate because project f14f328081484b82ab1633a6e64092aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:44.343044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.344538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.345832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86217f43319240f8a15749c543657653'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.346564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86217f43319240f8a15749c543657653'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.347253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b1524eb9-3e94-414e-ba47-33b33d26e10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86217f43319240f8a15749c543657653'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.350391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 911/1818] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:43 2022] DELETE /identity/v3/projects/f14f328081484b82ab1633a6e64092aa => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:44.351678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:44.353228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:44.402623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:44.430394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b74de-b489-4c8c-8d70-f1aca6a4cea0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:44.437419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:44.442808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:44.442808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:44.442808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] PATH_INFO: `/v3/users/ad6bfff5a85c4178879b12260d20dbf3` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:44.442808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad6bfff5a85c4178879b12260d20dbf3)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:44.442808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:44.474400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 908/1819] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:44 2022] DELETE /identity/v3/users/86217f43319240f8a15749c543657653 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:44.480416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:44.480788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:44.481122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:44.506465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:44.507773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:44.574707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 909/1820] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:44.581234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:44.584165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:44.683316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad6bfff5a85c4178879b12260d20dbf3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.684405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad6bfff5a85c4178879b12260d20dbf3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.699115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df88d3c-7311-419f-97ae-4e11fe27e041 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:44.701020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad6bfff5a85c4178879b12260d20dbf3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.708676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe547c-b92e-4a45-8be7-8b0b8795f8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:44.709624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe547c-b92e-4a45-8be7-8b0b8795f8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:44.709897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe547c-b92e-4a45-8be7-8b0b8795f8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:44.710257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe547c-b92e-4a45-8be7-8b0b8795f8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:44.727009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe547c-b92e-4a45-8be7-8b0b8795f8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:44.728704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe547c-b92e-4a45-8be7-8b0b8795f8f4 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:44.744054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 910/1821] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:44.773752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad6bfff5a85c4178879b12260d20dbf3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.794513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4b3ef289-f85b-4c45-b39d-c55d40cff9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad6bfff5a85c4178879b12260d20dbf3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:44.819869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 912/1822] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:44 2022] DELETE /identity/v3/users/ad6bfff5a85c4178879b12260d20dbf3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:44.886295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:44.886608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:44.887628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:44.948202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] MFA Rules not processed for user `f1094cb45bb14f48883b335ea232a8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:44.950831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:45.074922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 911/1823] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:45.095023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:45.096554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:45.097039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:45.138204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] MFA Rules not processed for user `169d4d93a4c04eb5807323ad5eeb0c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:45.139983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:45.253619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:45.312621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 913/1824] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:45.490383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:45.512717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:45.517378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:45.576238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:45.577860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:45.680097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:45.688617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b80b-2739-4f0e-a10b-ee8f5673c960 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:45.711355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:45.711355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:45.711355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:45.711355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:45.713234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:45.730863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:45.732868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:45.792933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 912/1825] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:45.794179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:45.799604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:45.849253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb28f7-dfa1-4483-9950-5fcfc30e07ed service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:45.852799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9893401-e1ae-407e-b494-50480d9336c6 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:45.856131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:45.856846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:45.857208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:45.857729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] PATH_INFO: `/v3/projects/8b0b93a6276241a58dc6203cc9263548` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:45.860435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0b93a6276241a58dc6203cc9263548)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:45.863882 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:45.867985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:45.868992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:45.869133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:45.869500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] PATH_INFO: `/v3/projects/60aa5d2dc8d04763adc5133d0038f81d` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:45.871604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60aa5d2dc8d04763adc5133d0038f81d)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:45.876271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:46.140468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60aa5d2dc8d04763adc5133d0038f81d', 'request_id': 'req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.157117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0b93a6276241a58dc6203cc9263548', 'request_id': 'req-85a749a1-f291-4142-8d58-80233a0bd255'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.169310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0b93a6276241a58dc6203cc9263548', 'request_id': 'req-85a749a1-f291-4142-8d58-80233a0bd255'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.170285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60aa5d2dc8d04763adc5133d0038f81d', 'request_id': 'req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.282681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60aa5d2dc8d04763adc5133d0038f81d', 'request_id': 'req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.311666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] The token cache is being invalidate because project 60aa5d2dc8d04763adc5133d0038f81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:46.312012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.315555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.319133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 914/1826] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:45 2022] DELETE /identity/v3/projects/60aa5d2dc8d04763adc5133d0038f81d => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:46.322933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:46.325362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:46.339460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0b93a6276241a58dc6203cc9263548', 'request_id': 'req-85a749a1-f291-4142-8d58-80233a0bd255'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.355083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] The token cache is being invalidate because project 8b0b93a6276241a58dc6203cc9263548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:46.357424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.361463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-85a749a1-f291-4142-8d58-80233a0bd255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.369727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 913/1827] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:45 2022] DELETE /identity/v3/projects/8b0b93a6276241a58dc6203cc9263548 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:46.374945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28c67-cd63-456f-a8a6-3ca487ddf9a3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:46.376886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28c67-cd63-456f-a8a6-3ca487ddf9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:46.376886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28c67-cd63-456f-a8a6-3ca487ddf9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:46.426387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-93b28c67-cd63-456f-a8a6-3ca487ddf9a3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:46.428491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-93b28c67-cd63-456f-a8a6-3ca487ddf9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:46.471849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe253c9-8f73-40c9-9deb-e3ba47afdcb9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:46.507600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:46.508226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:46.509278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:46.509756 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] PATH_INFO: `/v3/users/8d401b2173f44f7f87a14c7f01d18fcd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:46.511924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d401b2173f44f7f87a14c7f01d18fcd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:46.517185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:46.588930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 914/1828] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:46.606067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9444-8248-4aae-99cd-ab7bb8611d83 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:46.606496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9444-8248-4aae-99cd-ab7bb8611d83 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:46.606779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9444-8248-4aae-99cd-ab7bb8611d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:46.669940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-f02f9444-8248-4aae-99cd-ab7bb8611d83 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:46.673300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f02f9444-8248-4aae-99cd-ab7bb8611d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:46.686610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 915/1829] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:46.688379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9444-8248-4aae-99cd-ab7bb8611d83 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:46.700640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9444-8248-4aae-99cd-ab7bb8611d83 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:46.708065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:46.708716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:46.709100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:46.709396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:46.710091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:46.710381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:46.712432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:46.727458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 916/1830] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:47:46.733524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:46.750064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019675a-30ca-4266-bd2c-9ed81cf5535f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:46.764008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:46.764638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:46.764916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:46.765770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:46.766421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:46.773420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:46.801278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d401b2173f44f7f87a14c7f01d18fcd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.802142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d401b2173f44f7f87a14c7f01d18fcd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:46.819564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d401b2173f44f7f87a14c7f01d18fcd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:47.002659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d401b2173f44f7f87a14c7f01d18fcd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:47.022258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 917/1831] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:46 2022] POST /identity/v3/projects => generated 379 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:47.024036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:47.039877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d401b2173f44f7f87a14c7f01d18fcd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:47.062828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 915/1832] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:46 2022] DELETE /identity/v3/users/8d401b2173f44f7f87a14c7f01d18fcd => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:47:47.166451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7b81-7a2c-47a4-be88-a2a71dc5d3c9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:47.250373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:47.262533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:47.262533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:47.262533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:47.262533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:47.262533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:47.383649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 918/1833] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:47 2022] POST /identity/v3/users => generated 290 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:47:47.387986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:47.390713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:47.409339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15365448-bdde-4057-90d2-08a2cc1541b0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:47.422205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:47.422205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:47.422205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:47.422205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:47.422684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:47.422684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:47.473812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 916/1834] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:47.478879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:47.502721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015cd0-6bc8-43ce-9c24-c5b83915bb17 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:47.509787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ce173-1a47-4c18-bdac-145e51b6e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:47.510620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ce173-1a47-4c18-bdac-145e51b6e974 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:47.511305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ce173-1a47-4c18-bdac-145e51b6e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:47.511707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ce173-1a47-4c18-bdac-145e51b6e974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:47.515218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ce173-1a47-4c18-bdac-145e51b6e974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:47.524913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ce173-1a47-4c18-bdac-145e51b6e974 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:47.536492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 919/1835] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:47.539318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:47.610329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78650f15-99e3-4f92-8c93-c105a0be4950 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:47.623048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:47.635025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:47.635441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:47.635732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] PATH_INFO: `/v3/projects/50de1ded072e4422ae9709e25e3f9012/users/2b2afd7b16c446c59a159f2f08540b60/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:47.681235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50de1ded072e4422ae9709e25e3f9012, user_id=2b2afd7b16c446c59a159f2f08540b60, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:47.684523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:47.797538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:47.808550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 917/1836] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:47 2022] PUT /identity/v3/projects/50de1ded072e4422ae9709e25e3f9012/users/2b2afd7b16c446c59a159f2f08540b60/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:47.819032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:47.819967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:47.820414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:47.917474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] MFA Rules not processed for user `2b2afd7b16c446c59a159f2f08540b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:47.918558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:48.110742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 920/1837] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:48.115079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:48.250439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555c5be-dbc1-470f-bba4-94e41f64c59b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:48.256817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:48.258032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:48.258605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:48.259017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:48.259908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:48.262260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:48.333494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:48.356787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:48.358183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:48.374815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 918/1838] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:48 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:48.382816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699240-07fb-4c9f-a37f-5e97dac002cc None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:48.383224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:48.613876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:48.614538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:48.614837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:48.615101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] PATH_INFO: `/v3/projects/574a5de81ed54feaae74e1aa36f05330` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:48.617491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=574a5de81ed54feaae74e1aa36f05330)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:48.621499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:48.632967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549ce64-eed8-4cb3-8c94-a02e75922a08 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:48.668768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:48.669393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:48.669677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:48.670038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:48.670732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:48.672634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:48.837705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 919/1839] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:48 2022] POST /identity/v3/users => generated 295 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:48.841681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:48.874076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d995a-6f5b-4b9b-9636-e97092ef56f3 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:48.900127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574a5de81ed54feaae74e1aa36f05330', 'request_id': 'req-87e99de4-4ae4-473d-b5ae-770c362ecf5a'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:48.915050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574a5de81ed54feaae74e1aa36f05330', 'request_id': 'req-87e99de4-4ae4-473d-b5ae-770c362ecf5a'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:49.007350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:49.007684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.007933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.008244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.009090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:49.011574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:49.028189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 920/1840] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:49.040427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.054701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574a5de81ed54feaae74e1aa36f05330', 'request_id': 'req-87e99de4-4ae4-473d-b5ae-770c362ecf5a'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:49.085947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f338cec-8f7c-4ab7-bc8f-ec1b68924ffc admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:49.093124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:49.094299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.094583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.094882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] PATH_INFO: `/v3/projects/fa38bd25ddb54af3b4fdc9b1f4f3ec25/users/ea7d7307f9eb49adb953cc6ec42342ad/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.098123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] The token cache is being invalidate because project 574a5de81ed54feaae74e1aa36f05330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:47:49.099858 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:49.102936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-87e99de4-4ae4-473d-b5ae-770c362ecf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:47:49.119681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 921/1841] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:47:48 2022] DELETE /identity/v3/projects/574a5de81ed54feaae74e1aa36f05330 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:49.122845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74e2f7-60a1-49bd-83d8-dad8bb8370aa None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.124225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74e2f7-60a1-49bd-83d8-dad8bb8370aa None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.125135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74e2f7-60a1-49bd-83d8-dad8bb8370aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.125388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa38bd25ddb54af3b4fdc9b1f4f3ec25, user_id=ea7d7307f9eb49adb953cc6ec42342ad, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:49.133070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:49.156005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ab74e2f7-60a1-49bd-83d8-dad8bb8370aa None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:49.157897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ab74e2f7-60a1-49bd-83d8-dad8bb8370aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:49.175198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 922/1842] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:49.181408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7508d8-cec2-4346-8c2c-6432f508648c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.181705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7508d8-cec2-4346-8c2c-6432f508648c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.181981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7508d8-cec2-4346-8c2c-6432f508648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.209709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9f7508d8-cec2-4346-8c2c-6432f508648c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:49.211694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9f7508d8-cec2-4346-8c2c-6432f508648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:49.228083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 921/1843] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:49 2022] PUT /identity/v3/projects/fa38bd25ddb54af3b4fdc9b1f4f3ec25/users/ea7d7307f9eb49adb953cc6ec42342ad/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:49.232078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.234592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:49.300095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 923/1844] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:47:49.304905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7508d8-cec2-4346-8c2c-6432f508648c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.325663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7508d8-cec2-4346-8c2c-6432f508648c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:49.339830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:49.346617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.347078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.347469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.348384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:47:49.348796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:49.352502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:49.371073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f7c4-ff85-49ef-8f32-ff36f55121f8 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:49.379188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 924/1845] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:47:49.380817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.385413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:49.386181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.386469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.386746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.387489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:49.389886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:49.396430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac744-b47a-4b03-a674-cef766acd116 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:49.411361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:49.411779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.412538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.413419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.414510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:49.418011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:49.426250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 922/1846] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:47:49.436530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.459706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983ee2-0879-46e3-8118-cf8f740d834e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:49.465661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0500cba-d551-47a2-8617-6192853c971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:49.466379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0500cba-d551-47a2-8617-6192853c971e admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.466864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0500cba-d551-47a2-8617-6192853c971e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.467390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0500cba-d551-47a2-8617-6192853c971e admin admin] PATH_INFO: `/v3/projects/fa38bd25ddb54af3b4fdc9b1f4f3ec25/users/ea7d7307f9eb49adb953cc6ec42342ad/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.485559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0500cba-d551-47a2-8617-6192853c971e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa38bd25ddb54af3b4fdc9b1f4f3ec25, user_id=ea7d7307f9eb49adb953cc6ec42342ad, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:49.489390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0500cba-d551-47a2-8617-6192853c971e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:49.509300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 923/1847] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:49 2022] PUT /identity/v3/projects/fa38bd25ddb54af3b4fdc9b1f4f3ec25/users/ea7d7307f9eb49adb953cc6ec42342ad/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:49.525239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.526090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.526512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.621984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 925/1848] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:49 2022] POST /identity/v3/projects => generated 393 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:49.624270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.685813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] MFA Rules not processed for user `ea7d7307f9eb49adb953cc6ec42342ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:49.687228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:49.800264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec352f79-f3a4-431e-8611-efec394bd3b1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:49.817447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:49.820062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:49.820472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:49.821042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:49.821906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:49.825954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:49.854953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:49.952450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 924/1849] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:49.964420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 926/1850] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:49 2022] POST /identity/v3/users => generated 297 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:49.966202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.970913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:49.971489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:49.991922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e343f82-ea1b-48ff-a4d4-347a9edd89a1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:50.010676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:50.011788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:50.012189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:50.012471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:50.017083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:50.017083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:50.066687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 927/1851] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:50.070489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:50.093980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2c4e2-8fc1-4b72-a7e4-1ce30ca33b93 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:50.107651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:50.108376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:50.108823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:50.109093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:50.109833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:50.110590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c264c-d6b1-4128-b97b-dd822cb21816 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:50.115485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b714b-a09d-4139-beb9-c6256a41a0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:50.115722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:50.116727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b714b-a09d-4139-beb9-c6256a41a0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:50.117110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b714b-a09d-4139-beb9-c6256a41a0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:50.117497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b714b-a09d-4139-beb9-c6256a41a0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:50.121740 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-796b714b-a09d-4139-beb9-c6256a41a0c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:50.128463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 928/1852] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:50.132794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:50.159759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e4629-5930-498d-8438-7ca166baa01b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:50.171392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:50.172370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:50.172820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:50.173255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] PATH_INFO: `/v3/projects/bd7a5379c49b434f8b21d6f70bb77f0c/users/ea473e3a42dd468ea595cf3a790fc491/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:50.227141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7a5379c49b434f8b21d6f70bb77f0c, user_id=ea473e3a42dd468ea595cf3a790fc491, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:50.231472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:50.241533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b714b-a09d-4139-beb9-c6256a41a0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:50.243315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b714b-a09d-4139-beb9-c6256a41a0c1 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:50.266793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 925/1853] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:50.331038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 929/1854] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:50 2022] PUT /identity/v3/projects/bd7a5379c49b434f8b21d6f70bb77f0c/users/ea473e3a42dd468ea595cf3a790fc491/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:47:50.341894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c940ab-6698-4097-94e2-ec42accd22c3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:50.342435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c940ab-6698-4097-94e2-ec42accd22c3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:50.342715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c940ab-6698-4097-94e2-ec42accd22c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:50.393679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b6c940ab-6698-4097-94e2-ec42accd22c3 None None] MFA Rules not processed for user `ea473e3a42dd468ea595cf3a790fc491`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:50.395083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b6c940ab-6698-4097-94e2-ec42accd22c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:50.531654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 926/1855] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:50.536335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:50.663061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332744a3-69bc-48fe-b0fd-d172d8b1fc9a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:50.670809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:50.672218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:50.672546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:50.672828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:50.673665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:50.676076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:51.208662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:51.271496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 930/1856] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:47:50 2022] POST /identity/v3/projects => generated 391 bytes in 736 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:51.275702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c940ab-6698-4097-94e2-ec42accd22c3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:51.286245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c940ab-6698-4097-94e2-ec42accd22c3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:51.351543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:51.352173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.352445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.353511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.353511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:51.355459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:51.534507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 927/1857] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:47:51 2022] POST /identity/v3/users => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:47:51.538428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:51.551697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b82726-02cd-4ca0-807f-4ef6df941d7f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:51.557801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:51.558527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.558904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.559273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.572111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:51.572111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:51.572585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 931/1858] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:51.577105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:51.586889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd9d9-c5b0-4998-80e9-9a8dfa861402 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:51.591614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aa360-a66a-4642-9410-ca0e5ddbec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:51.592271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa360-a66a-4642-9410-ca0e5ddbec55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.592551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa360-a66a-4642-9410-ca0e5ddbec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.593401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa360-a66a-4642-9410-ca0e5ddbec55 admin admin] PATH_INFO: `/v3/projects/bf34b40a64c94f80b879fe15f9791eca/users/424cfccdcd5e4b13977c6008bddc1912/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.609280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa360-a66a-4642-9410-ca0e5ddbec55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf34b40a64c94f80b879fe15f9791eca, user_id=424cfccdcd5e4b13977c6008bddc1912, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:51.612043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa360-a66a-4642-9410-ca0e5ddbec55 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:51.703511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 928/1859] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:51 2022] PUT /identity/v3/projects/bf34b40a64c94f80b879fe15f9791eca/users/424cfccdcd5e4b13977c6008bddc1912/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:47:51.703624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:51.729324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:51.729324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67976af7-0e64-49d0-b348-90521dd0b926 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:51.773742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad427-0d41-413e-b1dc-9f9b75a92121 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.773929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad427-0d41-413e-b1dc-9f9b75a92121 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.774200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad427-0d41-413e-b1dc-9f9b75a92121 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.775585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 929/1860] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:47:51.784239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.784522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.784796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.820529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:51.821757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:51.838342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:51.841269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.841269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.841269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.841269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:51.844237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:51.855205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 932/1861] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:47:51.858138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:51.877000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6986677-22ec-485e-8d31-5628576044d5 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:51.882284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1fc68-b8ea-4ac9-aea2-e7f382ae3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:51.883208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fc68-b8ea-4ac9-aea2-e7f382ae3bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.883556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fc68-b8ea-4ac9-aea2-e7f382ae3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.883919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fc68-b8ea-4ac9-aea2-e7f382ae3bba admin admin] PATH_INFO: `/v3/projects/bf34b40a64c94f80b879fe15f9791eca/users/424cfccdcd5e4b13977c6008bddc1912/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.886530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1fc68-b8ea-4ac9-aea2-e7f382ae3bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf34b40a64c94f80b879fe15f9791eca, user_id=424cfccdcd5e4b13977c6008bddc1912, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:51.888992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1fc68-b8ea-4ac9-aea2-e7f382ae3bba admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:51.908248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 933/1862] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:47:51 2022] PUT /identity/v3/projects/bf34b40a64c94f80b879fe15f9791eca/users/424cfccdcd5e4b13977c6008bddc1912/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:47:51.922045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945547a2-d795-4553-ba86-d2851017933f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:51.922045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945547a2-d795-4553-ba86-d2851017933f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:51.922045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945547a2-d795-4553-ba86-d2851017933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:51.923765 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 930/1863] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:47:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:51.956516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-945547a2-d795-4553-ba86-d2851017933f None None] MFA Rules not processed for user `424cfccdcd5e4b13977c6008bddc1912`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:47:51.957727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:51.957940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-945547a2-d795-4553-ba86-d2851017933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:51.959565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:51.977068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5cab-577e-4bee-a178-6dfab01bf5d3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:52.094188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 934/1864] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:47:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:47:52.104480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:52.105114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:52.105390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:52.105661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:52.118386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:52.120079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:52.133511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 931/1865] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:47:52.193987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945547a2-d795-4553-ba86-d2851017933f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:52.193987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-945547a2-d795-4553-ba86-d2851017933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:47:52.246327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945547a2-d795-4553-ba86-d2851017933f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:52.250064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:52.255635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:52.255635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:52.255635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:52.261003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:52.262504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:52.273195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 935/1866] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:52 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:52.326067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:52.335101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c6246-0309-4a31-8b1d-8078439d6264 service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:52.339223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:52.341781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:52.341781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:52.341781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:52.401431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:52.402944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:52.411905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 932/1867] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:53.960559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:53.970295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189f535-98f4-438a-9caf-d5eeb1e409b5 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:53.974623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1da21-a1bc-4a1b-b183-88276ab77a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:53.975419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1da21-a1bc-4a1b-b183-88276ab77a24 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:53.975747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1da21-a1bc-4a1b-b183-88276ab77a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:53.976219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1da21-a1bc-4a1b-b183-88276ab77a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:54.019463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:54.054010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1da21-a1bc-4a1b-b183-88276ab77a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:54.056351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1da21-a1bc-4a1b-b183-88276ab77a24 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:47:54.072842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 936/1868] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:47:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:47:54.625058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:54.887319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:57.070356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:57.425688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:59.207119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:59.853534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:59.888836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:47:59.950525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a31f41-60eb-4c14-933a-fd3d27b7c11b service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:47:59.955760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:47:59.956402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:47:59.956678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:47:59.957001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] PATH_INFO: `/v3/users/ea473e3a42dd468ea595cf3a790fc491` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:47:59.958115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea473e3a42dd468ea595cf3a790fc491)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:47:59.960209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:00.218371 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea473e3a42dd468ea595cf3a790fc491'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.219948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea473e3a42dd468ea595cf3a790fc491'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.229436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea473e3a42dd468ea595cf3a790fc491'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.344238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea473e3a42dd468ea595cf3a790fc491'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.358933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea473e3a42dd468ea595cf3a790fc491'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.365792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 933/1869] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:47:59 2022] DELETE /identity/v3/users/ea473e3a42dd468ea595cf3a790fc491 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:00.370257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:00.371207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:00.371772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:00.394001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:00.395725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:00.467230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 937/1870] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:00.480351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:00.482135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:00.556725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c30ca-f77d-46e2-877c-1b67ecda5f33 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:00.560977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b9cb4-c356-4b9b-8977-425cee93b61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:00.561608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9cb4-c356-4b9b-8977-425cee93b61d service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:00.564228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9cb4-c356-4b9b-8977-425cee93b61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:00.564615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9cb4-c356-4b9b-8977-425cee93b61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:00.583059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b9cb4-c356-4b9b-8977-425cee93b61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:00.584465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b9cb4-c356-4b9b-8977-425cee93b61d service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:00.595096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:00.595656 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 934/1871] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:48:00.597055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:00.623363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ab4d-37db-460a-ae65-e4da590b0752 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:00.623363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:00.623363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:00.623363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:00.623733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] PATH_INFO: `/v3/users/97c3ca99afa945f09dbd027478168186` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:00.623733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c3ca99afa945f09dbd027478168186)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:00.623733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:00.820563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c3ca99afa945f09dbd027478168186'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.834019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c3ca99afa945f09dbd027478168186'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.842056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c3ca99afa945f09dbd027478168186'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.842902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c3ca99afa945f09dbd027478168186'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.844297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c3ca99afa945f09dbd027478168186'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:00.953312 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 938/1872] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:00 2022] DELETE /identity/v3/users/97c3ca99afa945f09dbd027478168186 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:00.964256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:00.965973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:00.966427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:00.966868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:00.967555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:00.987132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:00.988399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.033788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800fc60-da2b-405c-aa1e-145c244a718f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:01.038901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:01.039587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.043921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.043921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] PATH_INFO: `/v3/users/2b2afd7b16c446c59a159f2f08540b60` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.043921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2afd7b16c446c59a159f2f08540b60)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:01.043921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:01.076969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 935/1873] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:01.087390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:01.088994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.102450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458de42-ad4f-43ad-b1bd-de021d8d3dd2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:01.107392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:01.108224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.108574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.108845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] PATH_INFO: `/v3/projects/bd7a5379c49b434f8b21d6f70bb77f0c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.110011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7a5379c49b434f8b21d6f70bb77f0c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:01.111973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:01.267800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7a5379c49b434f8b21d6f70bb77f0c', 'request_id': 'req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.268970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2afd7b16c446c59a159f2f08540b60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.273612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7a5379c49b434f8b21d6f70bb77f0c', 'request_id': 'req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.282423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2afd7b16c446c59a159f2f08540b60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.290981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2afd7b16c446c59a159f2f08540b60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.291754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2afd7b16c446c59a159f2f08540b60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.292610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f0263e34-f711-45f1-8beb-34d0bfd5b5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2afd7b16c446c59a159f2f08540b60'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.344018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:01.378453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7a5379c49b434f8b21d6f70bb77f0c', 'request_id': 'req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.391565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] The token cache is being invalidate because project bd7a5379c49b434f8b21d6f70bb77f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:01.391857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.392530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.394093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 936/1874] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:01 2022] DELETE /identity/v3/projects/bd7a5379c49b434f8b21d6f70bb77f0c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:01.397058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:01.397058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.462443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 939/1875] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:00 2022] DELETE /identity/v3/users/2b2afd7b16c446c59a159f2f08540b60 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:01.464340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5aefa-a9f4-4c8f-aa2c-f8f68dababe5 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.464625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5aefa-a9f4-4c8f-aa2c-f8f68dababe5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.464896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5aefa-a9f4-4c8f-aa2c-f8f68dababe5 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.466261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 940/1876] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:48:01.466954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5aefa-a9f4-4c8f-aa2c-f8f68dababe5 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:01.468998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1eb5aefa-a9f4-4c8f-aa2c-f8f68dababe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.471763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc90a6-5ba5-4587-985d-b38cac6a83d3 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:01.530705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea2b47-4913-4585-894c-a17b06dcc2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:01.531374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2b47-4913-4585-894c-a17b06dcc2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.531649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2b47-4913-4585-894c-a17b06dcc2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.531923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2b47-4913-4585-894c-a17b06dcc2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.533675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-96ea2b47-4913-4585-894c-a17b06dcc2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.544558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5aefa-a9f4-4c8f-aa2c-f8f68dababe5 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:01.547373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2b47-4913-4585-894c-a17b06dcc2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:01.551355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2b47-4913-4585-894c-a17b06dcc2a6 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:01.551469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:01.551469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.551735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.552012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] PATH_INFO: `/v3/users/424cfccdcd5e4b13977c6008bddc1912` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.553181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=424cfccdcd5e4b13977c6008bddc1912)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:01.555689 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:01.558890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 937/1877] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:01.573129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d608-ed0b-433a-97e8-e3f9a0158705 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.573129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d608-ed0b-433a-97e8-e3f9a0158705 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.573129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d608-ed0b-433a-97e8-e3f9a0158705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.592432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c0f7d608-ed0b-433a-97e8-e3f9a0158705 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:01.593736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c0f7d608-ed0b-433a-97e8-e3f9a0158705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.614048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 938/1878] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:01.615679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.616257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.616745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.650991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:01.650991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.745723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 939/1879] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:01.746749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:01.748450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.762430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18924ff0-175d-4d06-9b45-96f9a31322bf None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:01.767447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:01.768243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.768544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.768858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.783410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:01.785081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:01.792440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '424cfccdcd5e4b13977c6008bddc1912'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.797676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 940/1880] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:01.807079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '424cfccdcd5e4b13977c6008bddc1912'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.817931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '424cfccdcd5e4b13977c6008bddc1912'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.819638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '424cfccdcd5e4b13977c6008bddc1912'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.832976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '424cfccdcd5e4b13977c6008bddc1912'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:01.836023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:01.836023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.846295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a924b2-13fc-4eb2-9dd5-0c5784c57ec3 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:01.853131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:01.853744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:01.854013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:01.854289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:01.856068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:01.872141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:01.873982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:01.886282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 941/1881] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:01.912168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 941/1882] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:01 2022] DELETE /identity/v3/users/424cfccdcd5e4b13977c6008bddc1912 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:02.075610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:02.157527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:02.159314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:02.174503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595068f-ec61-45aa-ba30-367e34553140 service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:02.247037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:02.247725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:02.248013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:02.248301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] PATH_INFO: `/v3/projects/511c6489733c4a09b6ecfaaec22a6881` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:02.249423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=511c6489733c4a09b6ecfaaec22a6881)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:02.251717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:02.373600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:02.375002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:02.385543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511c6489733c4a09b6ecfaaec22a6881', 'request_id': 'req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.393015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511c6489733c4a09b6ecfaaec22a6881', 'request_id': 'req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.393307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7076d81-1836-452c-a658-0d8188a716f6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:02.454597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:02.455184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:02.455476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:02.455742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] PATH_INFO: `/v3/projects/50de1ded072e4422ae9709e25e3f9012` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:02.459443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50de1ded072e4422ae9709e25e3f9012)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:02.461401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:02.475046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511c6489733c4a09b6ecfaaec22a6881', 'request_id': 'req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.490396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] The token cache is being invalidate because project 511c6489733c4a09b6ecfaaec22a6881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:02.490734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.491442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.492991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 942/1883] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:02 2022] DELETE /identity/v3/projects/511c6489733c4a09b6ecfaaec22a6881 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:02.493754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:02.496936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:02.509470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff5795-bff1-4a9e-b085-cfb03b0bd98b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:02.514031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:02.514652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:02.514928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:02.515753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] PATH_INFO: `/v3/projects/bf34b40a64c94f80b879fe15f9791eca` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:02.516869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf34b40a64c94f80b879fe15f9791eca)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:02.518765 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:02.576939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50de1ded072e4422ae9709e25e3f9012', 'request_id': 'req-3fcdd0f3-fc69-44f7-aad0-516383080044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.584649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50de1ded072e4422ae9709e25e3f9012', 'request_id': 'req-3fcdd0f3-fc69-44f7-aad0-516383080044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.631109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf34b40a64c94f80b879fe15f9791eca', 'request_id': 'req-2597a78c-a035-46b5-b047-75562055d754'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.638983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf34b40a64c94f80b879fe15f9791eca', 'request_id': 'req-2597a78c-a035-46b5-b047-75562055d754'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.680776 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50de1ded072e4422ae9709e25e3f9012', 'request_id': 'req-3fcdd0f3-fc69-44f7-aad0-516383080044'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.692656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] The token cache is being invalidate because project 50de1ded072e4422ae9709e25e3f9012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:02.693801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.694470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.696072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 942/1884] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:02 2022] DELETE /identity/v3/projects/50de1ded072e4422ae9709e25e3f9012 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:02.697148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:02.699886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:02.765000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd0f3-fc69-44f7-aad0-516383080044 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:02.766610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf34b40a64c94f80b879fe15f9791eca', 'request_id': 'req-2597a78c-a035-46b5-b047-75562055d754'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.799434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] The token cache is being invalidate because project bf34b40a64c94f80b879fe15f9791eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:02.799746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.800503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:02.802062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 943/1885] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:02 2022] DELETE /identity/v3/projects/bf34b40a64c94f80b879fe15f9791eca => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:02.802832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:02.808540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:02.825817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:02.827970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:02.827970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:02.827970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] PATH_INFO: `/v3/users/7b077d21598d4b688f0b2e961e2a3951` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:02.828848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b077d21598d4b688f0b2e961e2a3951)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:02.830929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:02.890096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a78c-a035-46b5-b047-75562055d754 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:02.895315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:02.895960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:02.896518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:02.898512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] PATH_INFO: `/v3/users/ea7d7307f9eb49adb953cc6ec42342ad` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:02.898512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7d7307f9eb49adb953cc6ec42342ad)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:02.900153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.117367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b077d21598d4b688f0b2e961e2a3951'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.129888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b077d21598d4b688f0b2e961e2a3951'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.137257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b077d21598d4b688f0b2e961e2a3951'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.137954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b077d21598d4b688f0b2e961e2a3951'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.138567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7a73437a-ccd5-49da-9576-829ff494f8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b077d21598d4b688f0b2e961e2a3951'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.145953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7d7307f9eb49adb953cc6ec42342ad'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.146737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7d7307f9eb49adb953cc6ec42342ad'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.154935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7d7307f9eb49adb953cc6ec42342ad'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.242916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 943/1886] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:02 2022] DELETE /identity/v3/users/7b077d21598d4b688f0b2e961e2a3951 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:03.242916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247898-7145-4e5e-b5f6-2e898875c8b4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.242916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247898-7145-4e5e-b5f6-2e898875c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.242916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247898-7145-4e5e-b5f6-2e898875c8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.268483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ec247898-7145-4e5e-b5f6-2e898875c8b4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:03.269740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ec247898-7145-4e5e-b5f6-2e898875c8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:03.327372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7d7307f9eb49adb953cc6ec42342ad'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.339323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 944/1887] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:03.341981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.343609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.344023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.345533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7d7307f9eb49adb953cc6ec42342ad'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.352884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 944/1888] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:02 2022] DELETE /identity/v3/users/ea7d7307f9eb49adb953cc6ec42342ad => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:03.367266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:03.368673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:03.434939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 945/1889] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:03.439340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.452638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733755f4-005f-4f72-9ee7-7ca8aedb38b4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:03.458177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:03.459101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.459438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.459679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.460341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:03.460638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:03.462351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.467335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.469404 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:03.479062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 945/1890] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:03.480271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.493457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad9f2f-2a74-4787-b3cf-191753ed7dd7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:03.496106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea1f3e-f553-4bfd-809f-e218fe301a8f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:03.500266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:03.501146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.501968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.502495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.503400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:03.504008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:03.504596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.505211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.506165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.506279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] PATH_INFO: `/v3/users/34cfd87a7d7f49fca5a681de833a20b8` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.507774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cfd87a7d7f49fca5a681de833a20b8)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:03.509895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.611977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 946/1891] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:03 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:03.613584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.699736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a4ae-1106-4743-be4a-c0c96fc56794 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:03.705249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:03.705865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.706200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.706479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.707124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:03.709157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.749321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cfd87a7d7f49fca5a681de833a20b8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.766957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cfd87a7d7f49fca5a681de833a20b8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.777412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cfd87a7d7f49fca5a681de833a20b8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.778286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cfd87a7d7f49fca5a681de833a20b8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.781421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cfd87a7d7f49fca5a681de833a20b8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:03.791234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 947/1892] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:03 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:03.795908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.797879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:03.817925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280d56-1506-4ef6-bdc4-4dd346185252 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:03.822224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:03.822829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.823108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.823425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.824068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:03.825660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.836338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 948/1893] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:03.840281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.850650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbac5f-f2b5-4295-9e79-d093cac03d93 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:03.855370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:03.856052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.856361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.856629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.857264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:03.858880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.869591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 949/1894] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:03.873797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.885658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5586e6-7d0a-42b1-96eb-ee2282103416 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:03.896674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:03.896674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:03.896674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:03.896674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] PATH_INFO: `/v3/projects/445a052c9e2c4950b832e79aa5079e95/users/514f7dd714ad45698d6b4b57d68c9dba/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:03.913498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445a052c9e2c4950b832e79aa5079e95, user_id=514f7dd714ad45698d6b4b57d68c9dba, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:03.918189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 946/1895] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:03 2022] DELETE /identity/v3/users/34cfd87a7d7f49fca5a681de833a20b8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:03.918189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:03.918440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:03.918516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.006768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3a82-c433-4230-bc95-486350c375a7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.023305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.023305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.023305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.023305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] PATH_INFO: `/v3/projects/7a3d56bc487b4777b8ef7eacaa2c7271` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.023609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3d56bc487b4777b8ef7eacaa2c7271)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.025509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.033980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 950/1896] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:03 2022] PUT /identity/v3/projects/445a052c9e2c4950b832e79aa5079e95/users/514f7dd714ad45698d6b4b57d68c9dba/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:04.044616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:04.047101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.126188 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bc37-a85b-4f92-80ac-904ff5523103 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.135469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.136387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.136842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.137403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] PATH_INFO: `/v3/projects/fa38bd25ddb54af3b4fdc9b1f4f3ec25` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.138790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa38bd25ddb54af3b4fdc9b1f4f3ec25)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.141542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.145003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3d56bc487b4777b8ef7eacaa2c7271', 'request_id': 'req-75aa0f3c-872e-4831-a1e0-93be81f3ea70'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.155202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3d56bc487b4777b8ef7eacaa2c7271', 'request_id': 'req-75aa0f3c-872e-4831-a1e0-93be81f3ea70'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.220321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3d56bc487b4777b8ef7eacaa2c7271', 'request_id': 'req-75aa0f3c-872e-4831-a1e0-93be81f3ea70'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.235621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] The token cache is being invalidate because project 7a3d56bc487b4777b8ef7eacaa2c7271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:04.236156 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.236989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-75aa0f3c-872e-4831-a1e0-93be81f3ea70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.238781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 947/1897] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:03 2022] DELETE /identity/v3/projects/7a3d56bc487b4777b8ef7eacaa2c7271 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:04.243409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc787b5-3925-4f50-b5a4-d0451cbc713c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.243695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc787b5-3925-4f50-b5a4-d0451cbc713c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.243973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc787b5-3925-4f50-b5a4-d0451cbc713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.274962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-acc787b5-3925-4f50-b5a4-d0451cbc713c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:04.276287 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-acc787b5-3925-4f50-b5a4-d0451cbc713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.284020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa38bd25ddb54af3b4fdc9b1f4f3ec25', 'request_id': 'req-7c70e8a0-29bb-4955-9b63-9b9504ad7250'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.291864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa38bd25ddb54af3b4fdc9b1f4f3ec25', 'request_id': 'req-7c70e8a0-29bb-4955-9b63-9b9504ad7250'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.346768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 948/1898] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:04.348758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1516-49d2-4273-a415-e2e057009004 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.349157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1516-49d2-4273-a415-e2e057009004 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.349519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1516-49d2-4273-a415-e2e057009004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.351921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa38bd25ddb54af3b4fdc9b1f4f3ec25', 'request_id': 'req-7c70e8a0-29bb-4955-9b63-9b9504ad7250'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.379397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] The token cache is being invalidate because project fa38bd25ddb54af3b4fdc9b1f4f3ec25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:04.379788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.380537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7c70e8a0-29bb-4955-9b63-9b9504ad7250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:04.382335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 951/1899] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:04 2022] DELETE /identity/v3/projects/fa38bd25ddb54af3b4fdc9b1f4f3ec25 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:04.383497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.383848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.384197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.393519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-73ab1516-49d2-4273-a415-e2e057009004 None None] MFA Rules not processed for user `514f7dd714ad45698d6b4b57d68c9dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:04.394779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-73ab1516-49d2-4273-a415-e2e057009004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.405913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:04.407356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.416121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 952/1900] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:04.416896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:04.418012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.484957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 949/1901] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:04.484957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735f7c-2f9e-40a7-b35f-698c75103341 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.484957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735f7c-2f9e-40a7-b35f-698c75103341 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.484957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735f7c-2f9e-40a7-b35f-698c75103341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.489023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:04.509554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-97735f7c-2f9e-40a7-b35f-698c75103341 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:04.510709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-97735f7c-2f9e-40a7-b35f-698c75103341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.528822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 950/1902] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:04.528822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.528822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.528822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.530565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704942-edc9-45be-a12a-e292e8644c40 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.535317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4250e-584a-4ece-a34f-0d152d81ffd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.536783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4250e-584a-4ece-a34f-0d152d81ffd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.537342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4250e-584a-4ece-a34f-0d152d81ffd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.537629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4250e-584a-4ece-a34f-0d152d81ffd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.539992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-74d4250e-584a-4ece-a34f-0d152d81ffd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.552773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:04.554370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.555508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4250e-584a-4ece-a34f-0d152d81ffd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.556970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4250e-584a-4ece-a34f-0d152d81ffd8 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.563450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 951/1903] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:04.564202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:04.565456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.573083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 953/1904] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:04.574289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46993-f7a2-4efe-ac55-e7b8594152dc None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.574580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46993-f7a2-4efe-ac55-e7b8594152dc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.574941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46993-f7a2-4efe-ac55-e7b8594152dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.580320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f52a5a-47c1-4855-ba91-064d8ae08dfb None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.587843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.587843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.587843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.587843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.588276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.589914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.604075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d1c46993-f7a2-4efe-ac55-e7b8594152dc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:04.606067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d1c46993-f7a2-4efe-ac55-e7b8594152dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:04.616254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 954/1905] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:04.619463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46993-f7a2-4efe-ac55-e7b8594152dc None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:04.630210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46993-f7a2-4efe-ac55-e7b8594152dc None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.636251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.636877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.637158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.637433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.638165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:04.638475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.641358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.670996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 955/1906] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:04.672770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:04.682060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 952/1907] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:04.683413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:04.689006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107203c-cd03-46d9-8638-c99e224b576d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.789756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412736-90c9-46ff-9281-fea6797bd9fe admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.796753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.797456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.797930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.798038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.798675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.801317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.810279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.811650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.812001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.815114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.816334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:04.817187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.822065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.837026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 956/1908] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:04.837934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:04.853496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866acec-9109-4467-85d4-af186321c894 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:04.860520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:04.863790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:04.863790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:04.863790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:04.863790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:04.876330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:04.938056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 953/1909] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:04.938056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.006657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d668-fc02-438b-9b88-95a2b1e51954 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.008354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 957/1910] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:05.012469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.012878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.013446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.013799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.014623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.014777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.017068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.022659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077184b-f694-4e38-8f73-94534e029f6f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.027362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.027938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.028216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.028488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.029141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.031595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.081235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:05.116742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 958/1911] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:05 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:05.120379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.122883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 954/1912] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:04 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:05.123833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.130758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e0108-db36-4c27-8df0-9b3f7299e368 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.199358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.200506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.200789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.201119 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.201770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.203697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.205709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e86f9-7278-4486-850a-9db5594cd7e5 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.210467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.211116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.211410 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.211680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.212321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.214070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.214456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 959/1913] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:05.215479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.226460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 955/1914] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:05.227455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.229375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:05.230715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838c94-74b8-4e0c-ae06-62605f9186f0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.236358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.236985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.237269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.237548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.238188 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.240200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.243323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb0e98-b892-4a14-a2bc-13bba90337e6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.249969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.250602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.250880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.255181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] PATH_INFO: `/v3/projects/da78547ac93b43df996befd5da0dedfe` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.255181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da78547ac93b43df996befd5da0dedfe)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.255181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.384048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 960/1915] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:05 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:05.384873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.417974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b837c-5706-4ad4-b8ed-7db762e83184 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.442510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da78547ac93b43df996befd5da0dedfe', 'request_id': 'req-31c329f9-88c7-4414-b863-160cc8357b35'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:05.456553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da78547ac93b43df996befd5da0dedfe', 'request_id': 'req-31c329f9-88c7-4414-b863-160cc8357b35'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:05.510255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.510915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.511221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.511495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.512264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.513940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.524590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 961/1916] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:05.525417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.538617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2946774-7eec-48fd-bf19-8a8194ab376d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.543592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.544222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.544556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.544772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.545407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.547054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.558055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 962/1917] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:05.558879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.560904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da78547ac93b43df996befd5da0dedfe', 'request_id': 'req-31c329f9-88c7-4414-b863-160cc8357b35'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:05.569526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30942518-bc37-4b60-a9ec-de662b8d611d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.574336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.574753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] The token cache is being invalidate because project da78547ac93b43df996befd5da0dedfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:05.574907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.575208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.575486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.575634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:05.576122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.576992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:05.578359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.580613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 956/1918] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:05 2022] DELETE /identity/v3/projects/da78547ac93b43df996befd5da0dedfe => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:05.581552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.583915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:05.599654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 963/1919] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:05.599654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.599654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:05.599848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c329f9-88c7-4414-b863-160cc8357b35 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.603599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.604243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.604545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.604858 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] PATH_INFO: `/v3/projects/88f6d45c897f450da418eeb946e0bbfe/users/6c3b1d3a143d4a2f936fbc81bd9a9296/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.607951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c3dc9-328f-4e9f-bc7f-449519bce502 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.612774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.613428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.613708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.613980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] PATH_INFO: `/v3/projects/de66687049d24edfa39d25f35804dfdc/users/e77fe3697a5344cdbfd9c00447b24769/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.619859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f6d45c897f450da418eeb946e0bbfe, user_id=6c3b1d3a143d4a2f936fbc81bd9a9296, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.622680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.630136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=de66687049d24edfa39d25f35804dfdc, user_id=e77fe3697a5344cdbfd9c00447b24769, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.632837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.721494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 957/1920] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:05 2022] PUT /identity/v3/projects/88f6d45c897f450da418eeb946e0bbfe/users/6c3b1d3a143d4a2f936fbc81bd9a9296/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:05.722317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.723921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:05.749788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 964/1921] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:05 2022] PUT /identity/v3/projects/de66687049d24edfa39d25f35804dfdc/users/e77fe3697a5344cdbfd9c00447b24769/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:05.754298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:05.754298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:05.793120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2820432-9130-4081-a3de-4287462781ec admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.815236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef73ce5-5cb9-4409-9882-aab0bf6455ab admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:05.820051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72802542-66e6-4e16-b3f8-f8ba507b34dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.820657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72802542-66e6-4e16-b3f8-f8ba507b34dd admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.820941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72802542-66e6-4e16-b3f8-f8ba507b34dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.821218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72802542-66e6-4e16-b3f8-f8ba507b34dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.821879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72802542-66e6-4e16-b3f8-f8ba507b34dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.823484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72802542-66e6-4e16-b3f8-f8ba507b34dd admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.836913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 965/1922] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:05.836913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7e85-8312-41e6-be8e-9ffb98a6a55f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.836913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7e85-8312-41e6-be8e-9ffb98a6a55f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.836913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7e85-8312-41e6-be8e-9ffb98a6a55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.850613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:05.851279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.851560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.851834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] PATH_INFO: `/v3/users/8e338a0b0481409eb4ae1caa73648f6d` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.852977 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e338a0b0481409eb4ae1caa73648f6d)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:05.854892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:05.862368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-dbdd7e85-8312-41e6-be8e-9ffb98a6a55f None None] MFA Rules not processed for user `6c3b1d3a143d4a2f936fbc81bd9a9296`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:05.863618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-dbdd7e85-8312-41e6-be8e-9ffb98a6a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:05.925650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 966/1923] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:05.926886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012e858-d588-4308-a7f3-7b55d7608bd1 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:05.927201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012e858-d588-4308-a7f3-7b55d7608bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:05.927484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012e858-d588-4308-a7f3-7b55d7608bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:05.954629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-c012e858-d588-4308-a7f3-7b55d7608bd1 None None] MFA Rules not processed for user `e77fe3697a5344cdbfd9c00447b24769`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:05.955890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c012e858-d588-4308-a7f3-7b55d7608bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:06.018644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 967/1924] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:06.019458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012e858-d588-4308-a7f3-7b55d7608bd1 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.029556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012e858-d588-4308-a7f3-7b55d7608bd1 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.034119 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.034772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.035050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.035353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] PATH_INFO: `/v3/projects/ced9696e1b4249b1b3cc460e4529ca0e/users/309a2f2723df4a01a2f2faac0955dde7/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.050923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced9696e1b4249b1b3cc460e4529ca0e, user_id=309a2f2723df4a01a2f2faac0955dde7, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.053725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.077436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e338a0b0481409eb4ae1caa73648f6d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:06.095247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e338a0b0481409eb4ae1caa73648f6d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:06.104310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e338a0b0481409eb4ae1caa73648f6d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:06.106742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e338a0b0481409eb4ae1caa73648f6d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:06.107485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e338a0b0481409eb4ae1caa73648f6d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:06.178869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 968/1925] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:06 2022] PUT /identity/v3/projects/ced9696e1b4249b1b3cc460e4529ca0e/users/309a2f2723df4a01a2f2faac0955dde7/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:06.179727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.181350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:06.255435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55457e70-8700-4d27-9bd1-a1887653e812 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.261399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 958/1926] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:05 2022] DELETE /identity/v3/users/8e338a0b0481409eb4ae1caa73648f6d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:06.262045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c7d7a-12dd-4f59-be53-e6c8ec699f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.262847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.263190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c7d7a-12dd-4f59-be53-e6c8ec699f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.263760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c7d7a-12dd-4f59-be53-e6c8ec699f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.264042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c7d7a-12dd-4f59-be53-e6c8ec699f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.267177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:06.267337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c7d7a-12dd-4f59-be53-e6c8ec699f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.268916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c7d7a-12dd-4f59-be53-e6c8ec699f7e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.362530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 969/1927] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:06 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:06.363499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84156847-de71-4c06-bfcf-4e5b86791cbb admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.364050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf3a45-b73f-4b6c-a95b-0b26276f845a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.364337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf3a45-b73f-4b6c-a95b-0b26276f845a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.364612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf3a45-b73f-4b6c-a95b-0b26276f845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.371829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:06.399919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e1bf3a45-b73f-4b6c-a95b-0b26276f845a None None] MFA Rules not processed for user `309a2f2723df4a01a2f2faac0955dde7`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:06.401320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e1bf3a45-b73f-4b6c-a95b-0b26276f845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:06.438959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.439610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.439892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.440185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.440799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.442712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.469874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 970/1928] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:06.471132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf3a45-b73f-4b6c-a95b-0b26276f845a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.483252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf3a45-b73f-4b6c-a95b-0b26276f845a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.490227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.492859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.492859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.492859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.492859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.494060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.518273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 959/1929] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:06 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:06.521721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.522974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:06.585273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 971/1930] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:06 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:06.588275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.595003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571101cd-208b-4f88-8b9f-d0c14371731f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.600489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.600642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.600979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.601320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.602035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.604134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.626128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f7ddf-c167-49e5-adfd-5a1a20e19653 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.632433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.633218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.633845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.634368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.635744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.638166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.728126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 960/1931] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:06 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:06.729104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.794953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5d46-2458-466d-8daa-5c9551f0bc01 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.800398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.801076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.801416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.801862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.807292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.807431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 972/1932] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:06 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:06.807431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.807604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.813629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a3f1d-407f-4186-ae82-4a607496c5e9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.815090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 961/1933] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:06.815915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.821421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.822284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.822559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.822829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.827476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.827577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f573-5e64-4bf4-87c7-5985d22fbb54 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.827682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.830809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.831396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.831676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.831950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.832578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.834169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.844523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 962/1934] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:06.850224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.850446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:06.854844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3afe9-265b-46c2-8db5-1531da73b00e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.860051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.861175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.861483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.861757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] PATH_INFO: `/v3/projects/d398e29f6bb54e08b9f539a96dca7c89/users/f95dd02b32df4808ba20c43f59251ec1/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.877506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d398e29f6bb54e08b9f539a96dca7c89, user_id=f95dd02b32df4808ba20c43f59251ec1, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.880229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.908357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 973/1935] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:06 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:06.910556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.923626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c06b1-90a1-4308-bcfe-32169b7deaa8 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:06.928438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:06.929225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:06.939143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:06.939143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] PATH_INFO: `/v3/projects/5464eaf803ca48d49375a8cb083882dc/users/d301f23651ae450aaceb2bd67013adc7/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:06.944698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464eaf803ca48d49375a8cb083882dc, user_id=d301f23651ae450aaceb2bd67013adc7, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:06.948577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:06.995632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 963/1936] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:06 2022] PUT /identity/v3/projects/d398e29f6bb54e08b9f539a96dca7c89/users/f95dd02b32df4808ba20c43f59251ec1/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:06.996372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:06.997998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:07.063916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c4ee-fbf9-4d27-9043-ad41951b2454 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.064815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 974/1937] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:06 2022] PUT /identity/v3/projects/5464eaf803ca48d49375a8cb083882dc/users/d301f23651ae450aaceb2bd67013adc7/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:07.065472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.126698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6f8f-b939-480e-be36-73b8de2975ea admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.131726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.131948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.132337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.132584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.132871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.133131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.133251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] PATH_INFO: `/v3/projects/61ae6690fa4b4f478b7c1b63dc941ff5` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.133410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.134178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.134292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ae6690fa4b4f478b7c1b63dc941ff5)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.135817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.136203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.146946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 975/1938] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:07.147580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.158785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f90eb-83e3-45bd-b853-b296eb1ad34c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.163851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.164443 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.164747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.165015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.165657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.167520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.178016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 976/1939] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:07.178793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.188265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc0caf-e1ef-430c-8610-1aa8b00dbc46 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.193080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.193761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.194045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.194434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.195076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.196708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.207380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 977/1940] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:07.208525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.217976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58dd7-4116-4c1e-910c-01432248a8d8 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.223691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.224340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.224673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.224950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] PATH_INFO: `/v3/projects/39475c02d4884b498a0e2d9e8a6d0db6/users/c9b51cff684447d6813f4d71120c5778/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.239926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39475c02d4884b498a0e2d9e8a6d0db6, user_id=c9b51cff684447d6813f4d71120c5778, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.242583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.247836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:07.394116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 978/1941] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:07 2022] PUT /identity/v3/projects/39475c02d4884b498a0e2d9e8a6d0db6/users/c9b51cff684447d6813f4d71120c5778/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:07.398580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.410579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ae6690fa4b4f478b7c1b63dc941ff5', 'request_id': 'req-79c2f54f-8e23-4a46-9897-5ea90b03b836'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:07.417537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ae6690fa4b4f478b7c1b63dc941ff5', 'request_id': 'req-79c2f54f-8e23-4a46-9897-5ea90b03b836'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:07.481049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ae6690fa4b4f478b7c1b63dc941ff5', 'request_id': 'req-79c2f54f-8e23-4a46-9897-5ea90b03b836'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:07.486786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a379b4-a4d3-4b5b-ae02-22def79aea7e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.499821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] The token cache is being invalidate because project 61ae6690fa4b4f478b7c1b63dc941ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:07.501218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:07.502492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:07.507201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 964/1942] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:06 2022] DELETE /identity/v3/projects/61ae6690fa4b4f478b7c1b63dc941ff5 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:07.507201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.508764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:07.555450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.556171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.556452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.556791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] PATH_INFO: `/v3/projects/d398e29f6bb54e08b9f539a96dca7c89/users/f95dd02b32df4808ba20c43f59251ec1/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.559421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d398e29f6bb54e08b9f539a96dca7c89, user_id=f95dd02b32df4808ba20c43f59251ec1, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.561996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.575619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 979/1943] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:07 2022] PUT /identity/v3/projects/d398e29f6bb54e08b9f539a96dca7c89/users/f95dd02b32df4808ba20c43f59251ec1/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:07.576358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.579453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:07.591591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f54f-8e23-4a46-9897-5ea90b03b836 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.663549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e8a2a-e320-4879-ae3b-ee49c7d6dfc7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.665305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c0341-4414-4ac2-af37-79986e343f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.666038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0341-4414-4ac2-af37-79986e343f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.666404 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0341-4414-4ac2-af37-79986e343f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.666744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0341-4414-4ac2-af37-79986e343f91 admin admin] PATH_INFO: `/v3/projects/5464eaf803ca48d49375a8cb083882dc/users/d301f23651ae450aaceb2bd67013adc7/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.668346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4638b-ffeb-4516-98b5-03af49745737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.668950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4638b-ffeb-4516-98b5-03af49745737 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.669139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c0341-4414-4ac2-af37-79986e343f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464eaf803ca48d49375a8cb083882dc, user_id=d301f23651ae450aaceb2bd67013adc7, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.669239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4638b-ffeb-4516-98b5-03af49745737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.669492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4638b-ffeb-4516-98b5-03af49745737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.670139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4638b-ffeb-4516-98b5-03af49745737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.671762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4638b-ffeb-4516-98b5-03af49745737 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.672758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c0341-4414-4ac2-af37-79986e343f91 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.682495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 980/1944] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:07.683838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733a1e-ea9d-4954-a921-d005b44911d3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.684121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733a1e-ea9d-4954-a921-d005b44911d3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.685089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733a1e-ea9d-4954-a921-d005b44911d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.694121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 965/1945] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:07 2022] PUT /identity/v3/projects/5464eaf803ca48d49375a8cb083882dc/users/d301f23651ae450aaceb2bd67013adc7/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:07.695669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef972-c236-4475-9294-55bbb52aa525 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.695972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef972-c236-4475-9294-55bbb52aa525 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.696249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef972-c236-4475-9294-55bbb52aa525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.720899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ed733a1e-ea9d-4954-a921-d005b44911d3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:07.722145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ed733a1e-ea9d-4954-a921-d005b44911d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:07.738983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5d8ef972-c236-4475-9294-55bbb52aa525 None None] MFA Rules not processed for user `f95dd02b32df4808ba20c43f59251ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:07.741040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5d8ef972-c236-4475-9294-55bbb52aa525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:07.812411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 981/1946] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:07.814932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed733a1e-ea9d-4954-a921-d005b44911d3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:07.832952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed733a1e-ea9d-4954-a921-d005b44911d3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:07.838347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e006d-dca5-484d-a370-fde7f9f537dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:07.839232 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e006d-dca5-484d-a370-fde7f9f537dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.839586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e006d-dca5-484d-a370-fde7f9f537dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.840074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e006d-dca5-484d-a370-fde7f9f537dc admin admin] PATH_INFO: `/v3/projects/39475c02d4884b498a0e2d9e8a6d0db6/users/c9b51cff684447d6813f4d71120c5778/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.843130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e006d-dca5-484d-a370-fde7f9f537dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=39475c02d4884b498a0e2d9e8a6d0db6, user_id=c9b51cff684447d6813f4d71120c5778, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:07.846519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e006d-dca5-484d-a370-fde7f9f537dc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:07.861270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 982/1947] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:07 2022] PUT /identity/v3/projects/39475c02d4884b498a0e2d9e8a6d0db6/users/c9b51cff684447d6813f4d71120c5778/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:07.863197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.863487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.863755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.868145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 966/1948] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:07.870309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5608e3-0ea3-4603-ae83-224a945f0ea3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.870746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5608e3-0ea3-4603-ae83-224a945f0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.871178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5608e3-0ea3-4603-ae83-224a945f0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:07.894909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3e5608e3-0ea3-4603-ae83-224a945f0ea3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:07.896365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3e5608e3-0ea3-4603-ae83-224a945f0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:07.923648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] MFA Rules not processed for user `d301f23651ae450aaceb2bd67013adc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:07.925727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:07.989952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 967/1949] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:07.991434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365d4f-df0a-46f9-a3f5-6be5f1cb2810 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:07.992202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365d4f-df0a-46f9-a3f5-6be5f1cb2810 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:07.993307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365d4f-df0a-46f9-a3f5-6be5f1cb2810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.021817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 983/1950] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:08.022824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.024310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.026633 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-fe365d4f-df0a-46f9-a3f5-6be5f1cb2810 None None] MFA Rules not processed for user `c9b51cff684447d6813f4d71120c5778`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:08.027998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-fe365d4f-df0a-46f9-a3f5-6be5f1cb2810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.083530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e33843-1ee5-427f-91ff-9107581cda6b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.087211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.087841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.088117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.088381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.097286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 968/1951] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:08.098120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365d4f-df0a-46f9-a3f5-6be5f1cb2810 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.107773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365d4f-df0a-46f9-a3f5-6be5f1cb2810 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.115339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.119587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.119587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.119587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.119587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:08.119587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.119587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.131002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 969/1952] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:08.131902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.133649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.148040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38ead-22ac-4fda-8fc3-4b66dab4d8d8 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.150277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.150873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.151170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.151443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.157796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.159277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.160837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.162248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.169104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 984/1953] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:08.170009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.171694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 970/1954] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:08.174149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:08.181605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0c08-85c0-4827-9799-fcb558e1fbc9 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.187089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.188326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.188326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.188520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.189259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.191324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.201205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.210061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b445afb-c87e-45db-80fb-2db219bf4ad5 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.213790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.214539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.214816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.215085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.224664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.226097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.236076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 971/1955] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:08.236835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.247301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9029ffa-94e4-417d-ad2e-7f7073c59a74 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.252483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.253693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.253693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.253693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] PATH_INFO: `/v3/users/e77fe3697a5344cdbfd9c00447b24769` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.254760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77fe3697a5344cdbfd9c00447b24769)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.256745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.289704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 985/1956] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:08 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:08.290549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.346933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452a11-a9c3-44a2-83ef-322e29b22947 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.350667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.351301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.351579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.351850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.353591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.413223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.414588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.423865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 986/1957] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:08.424627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.459792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:08.481747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77fe3697a5344cdbfd9c00447b24769'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.495123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77fe3697a5344cdbfd9c00447b24769'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.503478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beaa29-3e0b-477a-a14a-0280ffbfe97f service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.504116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77fe3697a5344cdbfd9c00447b24769'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.504858 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77fe3697a5344cdbfd9c00447b24769'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.505626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77fe3697a5344cdbfd9c00447b24769'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.508490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e7bc-fcdf-41e8-8141-9e243f391998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.509128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e7bc-fcdf-41e8-8141-9e243f391998 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.509409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e7bc-fcdf-41e8-8141-9e243f391998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.509732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e7bc-fcdf-41e8-8141-9e243f391998 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.510346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e7bc-fcdf-41e8-8141-9e243f391998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.512292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e7bc-fcdf-41e8-8141-9e243f391998 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.574832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 972/1958] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:08 2022] DELETE /identity/v3/users/e77fe3697a5344cdbfd9c00447b24769 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:08.574832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.574832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.601460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 987/1959] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:08 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:08.602707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.603045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.604050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.627563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:08.628773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.674540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6215b5c-326a-4b69-b046-d4674a51530d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.681400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.682187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.682459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.682736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] PATH_INFO: `/v3/users/309a2f2723df4a01a2f2faac0955dde7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.684052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=309a2f2723df4a01a2f2faac0955dde7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.687200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.716077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 988/1960] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:08.717014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.718321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.730789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d1c05-d164-4b97-906d-e3098db5848f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.736108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.736712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.739366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.739366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.739366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.739620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.750666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 989/1961] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:08.752319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.755365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:08.815694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069907a8-0a10-4486-b54c-c88406a85639 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.819322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.819934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.820214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.820565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.830114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.831576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.841050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 990/1962] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:08.841908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.851956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633a53-ba4b-467d-a3b4-61a297e665cc service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.856802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.857394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.857737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.858030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.858659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.860961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.871428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 991/1963] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:08.875566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:08.885935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae1ba-bc21-4ad7-b388-6f9eb7af3b97 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:08.890483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a19c6-1492-4412-ace6-3937f1358dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:08.891189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a19c6-1492-4412-ace6-3937f1358dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:08.891475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a19c6-1492-4412-ace6-3937f1358dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:08.891824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a19c6-1492-4412-ace6-3937f1358dba admin admin] PATH_INFO: `/v3/projects/524ea0d2ed964a82aaa77150d3ba84b5/users/60ec6464e24a4e9e896081de6275d252/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:08.907275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a19c6-1492-4412-ace6-3937f1358dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=524ea0d2ed964a82aaa77150d3ba84b5, user_id=60ec6464e24a4e9e896081de6275d252, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:08.923479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a19c6-1492-4412-ace6-3937f1358dba admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:08.931304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309a2f2723df4a01a2f2faac0955dde7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.945016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309a2f2723df4a01a2f2faac0955dde7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.951996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309a2f2723df4a01a2f2faac0955dde7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.952707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309a2f2723df4a01a2f2faac0955dde7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:08.953310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f8741979-a5da-476a-9942-466b32c211c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309a2f2723df4a01a2f2faac0955dde7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:09.049323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 992/1964] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:08 2022] PUT /identity/v3/projects/524ea0d2ed964a82aaa77150d3ba84b5/users/60ec6464e24a4e9e896081de6275d252/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:09.059546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.059832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.060110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.103330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 973/1965] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:08 2022] DELETE /identity/v3/users/309a2f2723df4a01a2f2faac0955dde7 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:09.108242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.110442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.110939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.112722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] MFA Rules not processed for user `60ec6464e24a4e9e896081de6275d252`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:09.113968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:09.129107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:09.158978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:09.160418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:09.257685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 974/1966] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:09.261737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 993/1967] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:09.266167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.267990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:09.276888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.278408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:09.291262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa84338-8a2f-4dfd-8784-19b2877c74eb None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.298070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.298800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.299145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.299701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.300226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:09.302762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:09.356785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648bd46-fd4c-4ed1-ab39-8a0a9d39f17b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.361143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.361813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.362091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.362364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.374426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:09.375984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:09.390061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 994/1968] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:09.391109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.392556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:09.398457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 975/1969] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:09 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:09.415812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.422717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374b8e-abad-46ab-8666-8489c42443a1 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.498381 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.499141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.499453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.499821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] PATH_INFO: `/v3/projects/de66687049d24edfa39d25f35804dfdc` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.501230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=de66687049d24edfa39d25f35804dfdc)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:09.501939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885ba10-4b05-400f-bef3-e21526a61eff admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.504482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:09.507710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.508462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.508831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.509249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.509996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:09.512203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:09.607213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 976/1970] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:09 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:09.612019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.621840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3ea41-45cd-4c56-89af-8ae46da05dfe admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.626714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.627418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.627631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.627902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.628674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:09.630303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:09.661080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 977/1971] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:09.665252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.667190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de66687049d24edfa39d25f35804dfdc', 'request_id': 'req-d1bee9f2-123f-4306-9702-7a63d3f620eb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:09.677885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c683a2b-2de4-40bc-a48c-66a6bfc28571 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.681462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de66687049d24edfa39d25f35804dfdc', 'request_id': 'req-d1bee9f2-123f-4306-9702-7a63d3f620eb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:09.767315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.768140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.768409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.768684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] PATH_INFO: `/v3/projects/970df99853c74b1f9cc0902752d16683/users/d8d13016ca73415ca3754656f39ed953/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.789675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970df99853c74b1f9cc0902752d16683, user_id=d8d13016ca73415ca3754656f39ed953, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:09.792803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:09.813604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de66687049d24edfa39d25f35804dfdc', 'request_id': 'req-d1bee9f2-123f-4306-9702-7a63d3f620eb'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:09.826182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] The token cache is being invalidate because project de66687049d24edfa39d25f35804dfdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:09.826508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:09.827281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:09.831011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 995/1972] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:09 2022] DELETE /identity/v3/projects/de66687049d24edfa39d25f35804dfdc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:09.834863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.836295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:09.850887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee9f2-123f-4306-9702-7a63d3f620eb admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.857109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.857928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.858174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.858453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] PATH_INFO: `/v3/users/d301f23651ae450aaceb2bd67013adc7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:09.860179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d301f23651ae450aaceb2bd67013adc7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:09.863072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:09.896466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 978/1973] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:09 2022] PUT /identity/v3/projects/970df99853c74b1f9cc0902752d16683/users/d8d13016ca73415ca3754656f39ed953/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:09.902178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:09.907294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:09.991625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4067-6faf-47dc-b2f9-a834a6c956b0 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:09.998433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:09.999060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:09.999521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:09.999798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:10.001116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:10.002992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:10.017013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 979/1974] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:10.018167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:10.028711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ccb59-7d13-4dde-856d-cb6545700097 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:10.033916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689230d-9397-488a-89fb-43cfd03fc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:10.034627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689230d-9397-488a-89fb-43cfd03fc582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:10.034908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689230d-9397-488a-89fb-43cfd03fc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:10.035196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689230d-9397-488a-89fb-43cfd03fc582 admin admin] PATH_INFO: `/v3/projects/970df99853c74b1f9cc0902752d16683/users/d8d13016ca73415ca3754656f39ed953/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:10.037168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689230d-9397-488a-89fb-43cfd03fc582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970df99853c74b1f9cc0902752d16683, user_id=d8d13016ca73415ca3754656f39ed953, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:10.039862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689230d-9397-488a-89fb-43cfd03fc582 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:10.051486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 980/1975] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:10 2022] PUT /identity/v3/projects/970df99853c74b1f9cc0902752d16683/users/d8d13016ca73415ca3754656f39ed953/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:10.061905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:10.062234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:10.062533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:10.085596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:10.098597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] MFA Rules not processed for user `d8d13016ca73415ca3754656f39ed953`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:10.100100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:10.104715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd301f23651ae450aaceb2bd67013adc7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.105665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd301f23651ae450aaceb2bd67013adc7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.114292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd301f23651ae450aaceb2bd67013adc7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.175662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 981/1976] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:10.182427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:10.182427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:10.214288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd301f23651ae450aaceb2bd67013adc7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.250856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd301f23651ae450aaceb2bd67013adc7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.260194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 996/1977] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:09 2022] DELETE /identity/v3/users/d301f23651ae450aaceb2bd67013adc7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:10.260505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f39e7a-4322-467f-b531-3909e1d880f1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:10.261978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:10.263832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:10.341348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca4d8f-fba4-463a-9bc3-034fa9165cba admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:10.350294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:10.350950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:10.351257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:10.351993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] PATH_INFO: `/v3/projects/ced9696e1b4249b1b3cc460e4529ca0e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:10.353131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:10.354146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced9696e1b4249b1b3cc460e4529ca0e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:10.355674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:10.356177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:10.356305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:10.357000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:10.362831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:10.449772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:10.451257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:10.461631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 997/1978] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:10.488258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:10.514158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced9696e1b4249b1b3cc460e4529ca0e', 'request_id': 'req-7488fb7b-48f8-46c0-9e54-dbfb41346372'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.524892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced9696e1b4249b1b3cc460e4529ca0e', 'request_id': 'req-7488fb7b-48f8-46c0-9e54-dbfb41346372'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.660569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced9696e1b4249b1b3cc460e4529ca0e', 'request_id': 'req-7488fb7b-48f8-46c0-9e54-dbfb41346372'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.672691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] The token cache is being invalidate because project ced9696e1b4249b1b3cc460e4529ca0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:10.673138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.673992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:10.676332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 982/1979] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:10 2022] DELETE /identity/v3/projects/ced9696e1b4249b1b3cc460e4529ca0e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:10.680547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:10.682984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:10.696501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74d5c0-8f5d-468e-ad66-5fb9862d33e3 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:10.764577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:10.764577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:10.764577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:10.764577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] PATH_INFO: `/v3/users/c9b51cff684447d6813f4d71120c5778` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:10.766501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b51cff684447d6813f4d71120c5778)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:10.768687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:10.998365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:11.001179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:11.017463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b51cff684447d6813f4d71120c5778'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.019028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b51cff684447d6813f4d71120c5778'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.024535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fb7b-48f8-46c0-9e54-dbfb41346372 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:11.032071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b51cff684447d6813f4d71120c5778'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.032240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:11.032240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:11.032240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:11.032488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] PATH_INFO: `/v3/projects/5464eaf803ca48d49375a8cb083882dc` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:11.034232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5464eaf803ca48d49375a8cb083882dc)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:11.036737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:11.202449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b51cff684447d6813f4d71120c5778'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.228935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-77e5300a-ae30-452f-9ffd-71322c9a0d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b51cff684447d6813f4d71120c5778'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.235063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5464eaf803ca48d49375a8cb083882dc', 'request_id': 'req-99d62d8f-9f50-44e6-85d6-a90d02f59174'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.237790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 998/1980] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:10 2022] DELETE /identity/v3/users/c9b51cff684447d6813f4d71120c5778 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:11.247987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5464eaf803ca48d49375a8cb083882dc', 'request_id': 'req-99d62d8f-9f50-44e6-85d6-a90d02f59174'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.366896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5464eaf803ca48d49375a8cb083882dc', 'request_id': 'req-99d62d8f-9f50-44e6-85d6-a90d02f59174'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.379756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] The token cache is being invalidate because project 5464eaf803ca48d49375a8cb083882dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:11.380038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.380710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-99d62d8f-9f50-44e6-85d6-a90d02f59174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.384337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 983/1981] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:10 2022] DELETE /identity/v3/projects/5464eaf803ca48d49375a8cb083882dc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:11.387905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc688d-ca86-4021-8413-9aa3af0e178f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:11.388192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc688d-ca86-4021-8413-9aa3af0e178f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:11.388469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc688d-ca86-4021-8413-9aa3af0e178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:11.408365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0afc688d-ca86-4021-8413-9aa3af0e178f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:11.409613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0afc688d-ca86-4021-8413-9aa3af0e178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:11.472719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 999/1982] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:11.480632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5869d-e189-483a-ac0b-de8afdd9e565 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:11.481030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5869d-e189-483a-ac0b-de8afdd9e565 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:11.481395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5869d-e189-483a-ac0b-de8afdd9e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:11.508169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4ad5869d-e189-483a-ac0b-de8afdd9e565 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:11.508169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4ad5869d-e189-483a-ac0b-de8afdd9e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:11.513997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 984/1983] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:11.518471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc688d-ca86-4021-8413-9aa3af0e178f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:11.528512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc688d-ca86-4021-8413-9aa3af0e178f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:11.533504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:11.534131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:11.534384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:11.534652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:11.535402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:11.535716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:11.538465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:11.551732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1000/1984] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:48:11.563355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5869d-e189-483a-ac0b-de8afdd9e565 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:11.572797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5869d-e189-483a-ac0b-de8afdd9e565 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:11.577852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:11.578550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:11.578887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:11.579250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:11.579942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:11.581935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:11.712002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 985/1985] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:11 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:11.716698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:11.728851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3386d-5f04-4b08-a05d-74343c2ba520 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:11.831337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:11.832244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:11.832746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:11.833080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:11.836020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:11.837278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:11.839276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:11.840196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:11.853498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe5c4-b208-41f4-a50b-5650b8aa5c53 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:11.860590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:11.861347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:11.861750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:11.862181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] PATH_INFO: `/v3/projects/39475c02d4884b498a0e2d9e8a6d0db6` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:11.863468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39475c02d4884b498a0e2d9e8a6d0db6)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:11.865486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:11.974834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1001/1986] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:11 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:11.979230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:11.995303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39475c02d4884b498a0e2d9e8a6d0db6', 'request_id': 'req-f021b894-e7df-44b8-a6a8-3b14b6ef6717'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:11.998182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa288a5-ab7f-43f4-b623-9e843d10f84d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.005115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39475c02d4884b498a0e2d9e8a6d0db6', 'request_id': 'req-f021b894-e7df-44b8-a6a8-3b14b6ef6717'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.068947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.069689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.069843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.070118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.070770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.073953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.087200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1002/1987] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:12.090561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.105286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dd685-30f3-4cdd-b5e6-40e212cb9dd5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.110804 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.111080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.111353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.111625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.112355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.113965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.128668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1003/1988] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:12.132658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.142922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923549aa-7709-4b3c-ae80-b60076a39ab0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.147565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.148189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.148469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.148742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] PATH_INFO: `/v3/projects/9deb51606bd441348775702e236f7549/users/e9bfa2253cc54d139d09fa5de9cbaf77/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.163599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9deb51606bd441348775702e236f7549, user_id=e9bfa2253cc54d139d09fa5de9cbaf77, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.166241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.172866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39475c02d4884b498a0e2d9e8a6d0db6', 'request_id': 'req-f021b894-e7df-44b8-a6a8-3b14b6ef6717'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.184108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] The token cache is being invalidate because project 39475c02d4884b498a0e2d9e8a6d0db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:12.184459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.185130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f021b894-e7df-44b8-a6a8-3b14b6ef6717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.186740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 986/1989] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:11 2022] DELETE /identity/v3/projects/39475c02d4884b498a0e2d9e8a6d0db6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:12.191420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb5b3b-cdf1-45d7-b8c9-e45f12d2b04a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.191703 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb5b3b-cdf1-45d7-b8c9-e45f12d2b04a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.191979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb5b3b-cdf1-45d7-b8c9-e45f12d2b04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.216287 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2beb5b3b-cdf1-45d7-b8c9-e45f12d2b04a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:12.217493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2beb5b3b-cdf1-45d7-b8c9-e45f12d2b04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.226729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 987/1990] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:12.234483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f24203-1bb3-41ea-bf1e-2c4d25cb010f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.234967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f24203-1bb3-41ea-bf1e-2c4d25cb010f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.235448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f24203-1bb3-41ea-bf1e-2c4d25cb010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.249197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1004/1991] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:12 2022] PUT /identity/v3/projects/9deb51606bd441348775702e236f7549/users/e9bfa2253cc54d139d09fa5de9cbaf77/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:12.261942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.264392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.268765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-84f24203-1bb3-41ea-bf1e-2c4d25cb010f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:12.270030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-84f24203-1bb3-41ea-bf1e-2c4d25cb010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.335262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 988/1992] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:12.336449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2810-3b7a-4144-88ca-0754ad3c2bf4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.336734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2810-3b7a-4144-88ca-0754ad3c2bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.337008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2810-3b7a-4144-88ca-0754ad3c2bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.345108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bacad-e4d2-42c9-91a5-f4ac0b301e12 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.355663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.356046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.356491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.356766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] PATH_INFO: `/v3/users/60ec6464e24a4e9e896081de6275d252` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.357958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ec6464e24a4e9e896081de6275d252)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.360016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.377657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-cb5f2810-3b7a-4144-88ca-0754ad3c2bf4 None None] MFA Rules not processed for user `e9bfa2253cc54d139d09fa5de9cbaf77`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:12.379191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cb5f2810-3b7a-4144-88ca-0754ad3c2bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.445090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 989/1993] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:12.445942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2810-3b7a-4144-88ca-0754ad3c2bf4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.458853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2810-3b7a-4144-88ca-0754ad3c2bf4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.463756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.464365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.464642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.464912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.465596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:12.465859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.467479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.480762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 990/1994] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:12.481648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.485860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.502719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df2baf-6555-4ff2-b3e8-fe05372f87e9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.517767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.519467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.519467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.519467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.519713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.521674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.592562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ec6464e24a4e9e896081de6275d252'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.593131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ec6464e24a4e9e896081de6275d252'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.599955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ec6464e24a4e9e896081de6275d252'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.703994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 991/1995] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:12 2022] POST /identity/v3/projects => generated 389 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:12.703994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.720928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ec6464e24a4e9e896081de6275d252'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.743613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ec6464e24a4e9e896081de6275d252'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:12.749586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1005/1996] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:12 2022] DELETE /identity/v3/users/60ec6464e24a4e9e896081de6275d252 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:12.754351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.755768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.767287 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649d5b-aa3f-4d2a-bf3d-3137f7cdf8a2 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.828040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf70667-1679-4923-8a68-e870f46c3272 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.832179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.832793 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.832966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1608b3e-776a-4b7c-8deb-1204e5985aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.834040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.834040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.834194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608b3e-776a-4b7c-8deb-1204e5985aed admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.834194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608b3e-776a-4b7c-8deb-1204e5985aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.834318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.834386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608b3e-776a-4b7c-8deb-1204e5985aed admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.834877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1608b3e-776a-4b7c-8deb-1204e5985aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.835930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.837024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1608b3e-776a-4b7c-8deb-1204e5985aed admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.930786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1006/1997] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:12 2022] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:12.930786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6fe3d-cbf2-47c7-bd6d-9ba41fd34728 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.930786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6fe3d-cbf2-47c7-bd6d-9ba41fd34728 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.930786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6fe3d-cbf2-47c7-bd6d-9ba41fd34728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.949186 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-91b6fe3d-cbf2-47c7-bd6d-9ba41fd34728 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:12.950397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-91b6fe3d-cbf2-47c7-bd6d-9ba41fd34728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.958287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1007/1998] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:12.958897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6fe3d-cbf2-47c7-bd6d-9ba41fd34728 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.968361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6fe3d-cbf2-47c7-bd6d-9ba41fd34728 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:12.973414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:12.974006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:12.974287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:12.974558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:12.975252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:12.976927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:12.987461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1008/1999] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:12.987461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:12.987461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:12.996360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 992/2000] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:12 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:12.996360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.057428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef8b5-d6d2-4a2a-b5d1-2e78c7a4e8a2 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.065586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11032e27-5daa-4cc4-b898-98e4d8e5cbea admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.072047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.072742 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.073025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.073302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] PATH_INFO: `/v3/projects/a0bce10c81f0410fa7db5e1d1516f156/users/6899ae4e03894adbabaf858350a662d4/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.088468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:13.090357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bce10c81f0410fa7db5e1d1516f156, user_id=6899ae4e03894adbabaf858350a662d4, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.093495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.114475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.115051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.115395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.120490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.127742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.129180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.139339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1009/2001] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:13.139885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.142270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:13.157012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ea49f-fcef-454e-a9aa-9d95e1f3d2d9 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.162110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.162743 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.163026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.163433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.164183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.165985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.207318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 993/2002] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:12 2022] PUT /identity/v3/projects/a0bce10c81f0410fa7db5e1d1516f156/users/6899ae4e03894adbabaf858350a662d4/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:13.211387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.277064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ba71-17b4-491c-9939-30a854270c1f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.282316 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.282915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.283219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.283494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.284130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.286101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.295654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 994/2003] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:13.300602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.310417 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51b2e-b9bb-47ef-9c6d-4ae0bc0d80e9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.315779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1010/2004] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:13 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:13.316540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4b52d-0ffe-4b44-8a05-348e7fe6432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.317184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b52d-0ffe-4b44-8a05-348e7fe6432b admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.317460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b52d-0ffe-4b44-8a05-348e7fe6432b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.321323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b52d-0ffe-4b44-8a05-348e7fe6432b admin admin] PATH_INFO: `/v3/projects/a0bce10c81f0410fa7db5e1d1516f156/users/6899ae4e03894adbabaf858350a662d4/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.321323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4b52d-0ffe-4b44-8a05-348e7fe6432b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bce10c81f0410fa7db5e1d1516f156, user_id=6899ae4e03894adbabaf858350a662d4, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.322740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4b52d-0ffe-4b44-8a05-348e7fe6432b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.324250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.333468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 995/2005] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:13 2022] PUT /identity/v3/projects/a0bce10c81f0410fa7db5e1d1516f156/users/6899ae4e03894adbabaf858350a662d4/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:13.334053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4f66-7e0b-4922-933a-929977a5f757 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.343294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.343585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.344546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.377712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] MFA Rules not processed for user `6899ae4e03894adbabaf858350a662d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:13.378468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:13.426112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.426849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.427440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.427789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.428725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.430749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.442661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1011/2006] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:13.448738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.467552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152b34-2a0c-4232-b11d-6fc10da57e5e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.475747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.480887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.480887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.480887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.480887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.481233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 996/2007] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:13.481331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.491998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1012/2008] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:13.492726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.494278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:13.498141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.510214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692caa-e9c3-4ef0-b09c-771ae76f551e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.517043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.518109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.518539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.518994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] PATH_INFO: `/v3/projects/2c9e56792b6f467e8ad6c6927095027f/users/c21b6122414c4af39efe38187f82940d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.534008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:13.538451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9e56792b6f467e8ad6c6927095027f, user_id=c21b6122414c4af39efe38187f82940d, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.541452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.557599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbcaf6-f378-4f74-b874-bbd76fcc4add None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.562324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86e01c-384f-4375-bb7b-818a803a7515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.562594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86e01c-384f-4375-bb7b-818a803a7515 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.562871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86e01c-384f-4375-bb7b-818a803a7515 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.563138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86e01c-384f-4375-bb7b-818a803a7515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.572672 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86e01c-384f-4375-bb7b-818a803a7515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.574098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86e01c-384f-4375-bb7b-818a803a7515 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.585375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 997/2009] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:48:13.634054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1013/2010] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:13 2022] PUT /identity/v3/projects/2c9e56792b6f467e8ad6c6927095027f/users/c21b6122414c4af39efe38187f82940d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:13.635504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bcdd3-0e64-4c72-abf3-6c2c813666ca None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.635946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bcdd3-0e64-4c72-abf3-6c2c813666ca None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.636557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bcdd3-0e64-4c72-abf3-6c2c813666ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.692349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-996bcdd3-0e64-4c72-abf3-6c2c813666ca None None] MFA Rules not processed for user `c21b6122414c4af39efe38187f82940d`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:13.693605 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-996bcdd3-0e64-4c72-abf3-6c2c813666ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:13.788482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 998/2011] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:13.793124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.808887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bcdd3-0e64-4c72-abf3-6c2c813666ca None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:13.877055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b165bc8-904b-4040-99cb-dffdb96d17ab admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.884723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.885190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.885668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.886229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.888465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.901216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:13.920886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bcdd3-0e64-4c72-abf3-6c2c813666ca None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:13.926026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:13.926673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:13.926938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:13.927243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] PATH_INFO: `/v3/users/e9bfa2253cc54d139d09fa5de9cbaf77` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:13.930814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bfa2253cc54d139d09fa5de9cbaf77)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:13.930814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:14.122164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1014/2012] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:13 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:14.123532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:14.126048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:14.213983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2ef5-5fa2-48f4-bb27-696371c2bbf5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:14.219749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:14.220480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:14.220832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:14.221182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] PATH_INFO: `/v3/projects/524ea0d2ed964a82aaa77150d3ba84b5` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:14.222477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524ea0d2ed964a82aaa77150d3ba84b5)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:14.225086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:14.366292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bfa2253cc54d139d09fa5de9cbaf77'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.388029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bfa2253cc54d139d09fa5de9cbaf77'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.389729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524ea0d2ed964a82aaa77150d3ba84b5', 'request_id': 'req-025ec01e-c923-43de-8075-10cbacd15472'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.395292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bfa2253cc54d139d09fa5de9cbaf77'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.396022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bfa2253cc54d139d09fa5de9cbaf77'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.396668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bfa2253cc54d139d09fa5de9cbaf77'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.397659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524ea0d2ed964a82aaa77150d3ba84b5', 'request_id': 'req-025ec01e-c923-43de-8075-10cbacd15472'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.510198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 999/2013] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:13 2022] DELETE /identity/v3/users/e9bfa2253cc54d139d09fa5de9cbaf77 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:14.511426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:14.513162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:14.572508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524ea0d2ed964a82aaa77150d3ba84b5', 'request_id': 'req-025ec01e-c923-43de-8075-10cbacd15472'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.576533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0aace1-c45b-4cff-a9bc-462ea336fdf8 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:14.581604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25d18-7188-4bf5-9465-0dba36d052c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:14.582304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25d18-7188-4bf5-9465-0dba36d052c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:14.582564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25d18-7188-4bf5-9465-0dba36d052c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:14.582880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25d18-7188-4bf5-9465-0dba36d052c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:14.584225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25d18-7188-4bf5-9465-0dba36d052c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:14.585304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] The token cache is being invalidate because project 524ea0d2ed964a82aaa77150d3ba84b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:14.585596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.586248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.586764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25d18-7188-4bf5-9465-0dba36d052c2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:14.587928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1015/2014] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:14 2022] DELETE /identity/v3/projects/524ea0d2ed964a82aaa77150d3ba84b5 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:14.591621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:14.593031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:14.659949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec01e-c923-43de-8075-10cbacd15472 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:14.664613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:14.665238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:14.665577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:14.665848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] PATH_INFO: `/v3/users/514f7dd714ad45698d6b4b57d68c9dba` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:14.666961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] RBAC: Authorizing `identity:delete_user(user_id=514f7dd714ad45698d6b4b57d68c9dba)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:14.670304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:14.685401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1000/2015] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:14 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:14.685401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:14.685401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:14.685401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:14.707744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:14.709469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:14.721936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1001/2016] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:14.722976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:14.724429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:14.737291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b91c-1443-4388-9719-bafe957ab8b6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:14.742013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:14.742696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:14.742948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:14.743237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] PATH_INFO: `/v3/users/d8d13016ca73415ca3754656f39ed953` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:14.744408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d13016ca73415ca3754656f39ed953)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:14.746422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:14.884256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514f7dd714ad45698d6b4b57d68c9dba'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.884921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514f7dd714ad45698d6b4b57d68c9dba'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.891829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514f7dd714ad45698d6b4b57d68c9dba'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.947089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d13016ca73415ca3754656f39ed953'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.950045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514f7dd714ad45698d6b4b57d68c9dba'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.961718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d13016ca73415ca3754656f39ed953'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.963552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514f7dd714ad45698d6b4b57d68c9dba'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.969646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d13016ca73415ca3754656f39ed953'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.970435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d13016ca73415ca3754656f39ed953'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.971107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d13016ca73415ca3754656f39ed953'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:14.975645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1016/2017] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:14 2022] DELETE /identity/v3/users/514f7dd714ad45698d6b4b57d68c9dba => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:14.976668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:14.978148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.057404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43942f5c-4820-4122-bbc6-64f655f0ccec admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.062278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd235f77-992d-488f-b439-fe048f443c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.063394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd235f77-992d-488f-b439-fe048f443c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.063394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd235f77-992d-488f-b439-fe048f443c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.063615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd235f77-992d-488f-b439-fe048f443c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.064126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd235f77-992d-488f-b439-fe048f443c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.065729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd235f77-992d-488f-b439-fe048f443c4a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.073386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1002/2018] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:14 2022] DELETE /identity/v3/users/d8d13016ca73415ca3754656f39ed953 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:15.074413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:15.076757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1017/2019] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:15.080573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.080973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.081360 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.081681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.109813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:15.132359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:15.133655 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.186940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ac0e-824d-4bd4-b582-c3635b8edeb9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.192872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.193736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.194133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.194456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.197062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.226961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1018/2020] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:15.230462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:15.231915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.245735 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c5b5-f885-458d-b6dc-f129129e50c0 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.255959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.257649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.258022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.258622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] PATH_INFO: `/v3/projects/ee14cc6c69c144a58120cd2b567fa436/users/101cdee97db14a4e9cdb1a6392bc8e7b/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.285422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.286888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.296890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee14cc6c69c144a58120cd2b567fa436, user_id=101cdee97db14a4e9cdb1a6392bc8e7b, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.299636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.306568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1003/2021] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:15.307566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:15.315894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a83131-3426-4d38-82e8-1612b07b459f service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.319997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.324596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.324596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.324596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.332717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.334159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.344847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1004/2022] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:15.345372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:15.380578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1019/2023] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:15 2022] PUT /identity/v3/projects/ee14cc6c69c144a58120cd2b567fa436/users/101cdee97db14a4e9cdb1a6392bc8e7b/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:15.385722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:15.407268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ffc86-c9a9-4594-83cf-61da5ac60b1e service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.563907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b157e-60ca-44eb-a13c-94ea1519282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.564831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b157e-60ca-44eb-a13c-94ea1519282f admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.565169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b157e-60ca-44eb-a13c-94ea1519282f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.565884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b157e-60ca-44eb-a13c-94ea1519282f admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.566216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b157e-60ca-44eb-a13c-94ea1519282f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.568420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b157e-60ca-44eb-a13c-94ea1519282f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.580155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1005/2024] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:15.584289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:15.598004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c7342-848c-4e5b-b973-e341e4bf0267 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.603044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.603664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.604010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.604356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] PATH_INFO: `/v3/projects/ee14cc6c69c144a58120cd2b567fa436/users/101cdee97db14a4e9cdb1a6392bc8e7b/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.606521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee14cc6c69c144a58120cd2b567fa436, user_id=101cdee97db14a4e9cdb1a6392bc8e7b, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.609501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.622941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1020/2025] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:15 2022] PUT /identity/v3/projects/ee14cc6c69c144a58120cd2b567fa436/users/101cdee97db14a4e9cdb1a6392bc8e7b/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:15.635147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.636033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.636440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.681549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] MFA Rules not processed for user `101cdee97db14a4e9cdb1a6392bc8e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:15.682884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.763228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1006/2026] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:15.768046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:15.770216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.791932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:15.795408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:15.894381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f141aa-e7c5-4a54-ac19-c3ca87ed9dff None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.902148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.902148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.902148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.902453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] PATH_INFO: `/v3/projects/970df99853c74b1f9cc0902752d16683` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.903474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970df99853c74b1f9cc0902752d16683)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.905552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.915606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e231d-967e-40c8-8389-0547af41cc67 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:15.930848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:15.939427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:15.939744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:15.940036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:15.970467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:15.971953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:15.983044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1021/2027] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:16.122442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970df99853c74b1f9cc0902752d16683', 'request_id': 'req-8de9bef4-5f4c-4cf0-8c09-27e048625945'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.136252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970df99853c74b1f9cc0902752d16683', 'request_id': 'req-8de9bef4-5f4c-4cf0-8c09-27e048625945'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.190331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:16.192590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:16.224650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970df99853c74b1f9cc0902752d16683', 'request_id': 'req-8de9bef4-5f4c-4cf0-8c09-27e048625945'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.272762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef87224-ec9a-43a5-bc9f-3a5fadea5aea service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:16.276181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:16.299315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] The token cache is being invalidate because project 970df99853c74b1f9cc0902752d16683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:16.299674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.302944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8de9bef4-5f4c-4cf0-8c09-27e048625945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.307355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1007/2028] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:15 2022] DELETE /identity/v3/projects/970df99853c74b1f9cc0902752d16683 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:16.321556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:16.321891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:16.322146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:16.383244 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:16.388504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:16.463188 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:16.463986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:16.464276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:16.464550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] PATH_INFO: `/v3/projects/9deb51606bd441348775702e236f7549` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:16.466521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:16.469672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9deb51606bd441348775702e236f7549)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:16.471691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:16.530666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1008/2029] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:16.530666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:16.533046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:16.550823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda3bd-9723-402e-8786-34feccb17397 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:16.556847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:16.557503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:16.557889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:16.558321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] PATH_INFO: `/v3/projects/445a052c9e2c4950b832e79aa5079e95` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:16.559523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445a052c9e2c4950b832e79aa5079e95)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:16.561882 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:16.613974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9deb51606bd441348775702e236f7549', 'request_id': 'req-4caeed62-b45e-495a-9718-9be7227abe5a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.619524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9deb51606bd441348775702e236f7549', 'request_id': 'req-4caeed62-b45e-495a-9718-9be7227abe5a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.687938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:16.713570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445a052c9e2c4950b832e79aa5079e95', 'request_id': 'req-247e8b28-1276-4519-86b6-58978b734669'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.721322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445a052c9e2c4950b832e79aa5079e95', 'request_id': 'req-247e8b28-1276-4519-86b6-58978b734669'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.750267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9deb51606bd441348775702e236f7549', 'request_id': 'req-4caeed62-b45e-495a-9718-9be7227abe5a'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.765527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] The token cache is being invalidate because project 9deb51606bd441348775702e236f7549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:16.766918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.768011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4caeed62-b45e-495a-9718-9be7227abe5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.770226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1022/2030] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:16 2022] DELETE /identity/v3/projects/9deb51606bd441348775702e236f7549 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:16.771904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:16.772480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:16.773097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:16.798364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:16.799807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:16.847520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445a052c9e2c4950b832e79aa5079e95', 'request_id': 'req-247e8b28-1276-4519-86b6-58978b734669'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.867750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] The token cache is being invalidate because project 445a052c9e2c4950b832e79aa5079e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:16.871862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.873590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:16.885373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1023/2031] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:16.886682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:16.889730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1009/2032] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:16 2022] DELETE /identity/v3/projects/445a052c9e2c4950b832e79aa5079e95 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:16.890003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:16.892694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:16.893121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:16.910851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78064-2c71-4c4c-90e9-d302bf48ad2c None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:16.917255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:16.918624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:16.919841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:16.920269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] PATH_INFO: `/v3/users/6899ae4e03894adbabaf858350a662d4` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:16.921262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e8b28-1276-4519-86b6-58978b734669 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:16.923527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6899ae4e03894adbabaf858350a662d4)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:16.927496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:16.935723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:16.937485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:16.939006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:16.939006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:16.943041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:16.943041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:16.943041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:16.973360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1010/2033] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:16.975542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:16.980611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:16.995659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b092-4100-43b0-89f0-c1c536a6b829 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:17.001514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:17.002517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:17.003029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:17.003536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] PATH_INFO: `/v3/users/6c3b1d3a143d4a2f936fbc81bd9a9296` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:17.004951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3b1d3a143d4a2f936fbc81bd9a9296)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:17.007323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:17.151274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6899ae4e03894adbabaf858350a662d4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.151979 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6899ae4e03894adbabaf858350a662d4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.160240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6899ae4e03894adbabaf858350a662d4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.224907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3b1d3a143d4a2f936fbc81bd9a9296'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.240856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6899ae4e03894adbabaf858350a662d4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.244170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3b1d3a143d4a2f936fbc81bd9a9296'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.257197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3b1d3a143d4a2f936fbc81bd9a9296'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.258021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3b1d3a143d4a2f936fbc81bd9a9296'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.258864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3b1d3a143d4a2f936fbc81bd9a9296'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.268212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6899ae4e03894adbabaf858350a662d4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:17.275950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1024/2034] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:16 2022] DELETE /identity/v3/users/6899ae4e03894adbabaf858350a662d4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:17.277154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:17.289975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:17.330250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1011/2035] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:16 2022] DELETE /identity/v3/users/6c3b1d3a143d4a2f936fbc81bd9a9296 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:17.333378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:17.335570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:17.405433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349049b-ef12-4b66-b9bc-735efae4c5f4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:17.532427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:17.533398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:17.533784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:17.535476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:17.535476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:17.539149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:17.552904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59f0e-4d58-4ae6-a19a-523d61eca9a6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:17.560364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101cdee97db14a4e9cdb1a6392bc8e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee14cc6c69c144a58120cd2b567fa436', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:17.561056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:17.561339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:17.561613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:17.562331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:17.562712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:17.564966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:17.589214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1012/2036] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:17.591100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:17.593313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:17.623374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62d65f-42fc-4a7f-94f5-19610fdd2036 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:17.628855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101cdee97db14a4e9cdb1a6392bc8e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee14cc6c69c144a58120cd2b567fa436', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:17.629692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:17.630021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:17.630300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:17.631525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:17.633854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:17.707051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1025/2037] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:17 2022] POST /identity/v3/projects => generated 385 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:17.711946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:17.748021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1013/2038] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:17 2022] POST /identity/v3/projects => generated 354 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:17.754858 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:17.814816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f846-a510-4656-9bae-8bb249600139 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:17.852469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0576481-a1a9-40dd-9461-e6d0f5163538 tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:17.863369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101cdee97db14a4e9cdb1a6392bc8e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee14cc6c69c144a58120cd2b567fa436', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:17.863369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:17.863369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:17.863687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:17.863687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:17.863687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:17.864386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:17.879466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1014/2039] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:48:17.914509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:17.915301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:17.915738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:17.916188 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:17.917072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:17.919125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:17.946477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:17.956805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:17.988877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333db697-9a92-4b97-be7b-22c82a9a73ed tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:18.001860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '101cdee97db14a4e9cdb1a6392bc8e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee14cc6c69c144a58120cd2b567fa436', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:18.003852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:18.004134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:18.007608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] PATH_INFO: `/v3/projects/6ffd3720cda0446f86abdf2f05020350` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:18.008236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6ffd3720cda0446f86abdf2f05020350)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:18.010217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:18.079309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1026/2040] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:17 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:18.079309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:18.081097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:18.097014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b9cf1-66dd-4329-9e0a-e4e9871368bd admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:18.104092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:18.106097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:18.106633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:18.107059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] PATH_INFO: `/v3/projects/88f6d45c897f450da418eeb946e0bbfe` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:18.108446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f6d45c897f450da418eeb946e0bbfe)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:18.111365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:18.188432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffd3720cda0446f86abdf2f05020350', 'request_id': 'req-e161c7c3-e7d0-4f34-866a-31de7283417e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.201852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:18.214415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffd3720cda0446f86abdf2f05020350', 'request_id': 'req-e161c7c3-e7d0-4f34-866a-31de7283417e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.269466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f6d45c897f450da418eeb946e0bbfe', 'request_id': 'req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.277054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f6d45c897f450da418eeb946e0bbfe', 'request_id': 'req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.304210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffd3720cda0446f86abdf2f05020350', 'request_id': 'req-e161c7c3-e7d0-4f34-866a-31de7283417e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.318735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] The token cache is being invalidate because project 6ffd3720cda0446f86abdf2f05020350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:18.319018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.319740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.321314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1015/2041] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:17 2022] DELETE /identity/v3/projects/6ffd3720cda0446f86abdf2f05020350 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:18.324035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:18.325479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:18.403979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161c7c3-e7d0-4f34-866a-31de7283417e tempest-VolumeQuotaClassesTest-397771237 tempest-VolumeQuotaClassesTest-397771237-project-admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:18.426051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f6d45c897f450da418eeb946e0bbfe', 'request_id': 'req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.449219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] The token cache is being invalidate because project 88f6d45c897f450da418eeb946e0bbfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:18.449504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.450194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.452008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1027/2042] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:18 2022] DELETE /identity/v3/projects/88f6d45c897f450da418eeb946e0bbfe => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:18.458312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:18.458312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:18.471791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:18.472416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:18.472840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:18.473126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:18.473786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:18.477250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:18.489749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1016/2043] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:18.490722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:18.494201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:18.507349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb549cff-a2ea-4e62-a12d-c259b1be3d65 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:18.512953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:18.513615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:18.513924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:18.514199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] PATH_INFO: `/v3/users/f95dd02b32df4808ba20c43f59251ec1` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:18.515388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95dd02b32df4808ba20c43f59251ec1)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:18.517354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:18.541423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a253-6236-4c7d-b3fe-cbedb23fc151 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:18.546740 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:18.548245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:18.548588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:18.548922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] PATH_INFO: `/v3/projects/a0bce10c81f0410fa7db5e1d1516f156` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:18.550244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bce10c81f0410fa7db5e1d1516f156)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:18.552250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:18.708322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95dd02b32df4808ba20c43f59251ec1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.712368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bce10c81f0410fa7db5e1d1516f156', 'request_id': 'req-c83509df-1bbc-44de-a87b-b10b4a528d51'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.723045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95dd02b32df4808ba20c43f59251ec1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.723730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bce10c81f0410fa7db5e1d1516f156', 'request_id': 'req-c83509df-1bbc-44de-a87b-b10b4a528d51'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.731278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95dd02b32df4808ba20c43f59251ec1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.732300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95dd02b32df4808ba20c43f59251ec1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.733111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b7efea98-1a41-471d-a3ce-99bdb53482e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95dd02b32df4808ba20c43f59251ec1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.853121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bce10c81f0410fa7db5e1d1516f156', 'request_id': 'req-c83509df-1bbc-44de-a87b-b10b4a528d51'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.866604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] The token cache is being invalidate because project a0bce10c81f0410fa7db5e1d1516f156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:18.867239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.868152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:18.869985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1028/2044] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:18 2022] DELETE /identity/v3/projects/a0bce10c81f0410fa7db5e1d1516f156 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:18.874849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:18.876537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:18.939223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1017/2045] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:18 2022] DELETE /identity/v3/users/f95dd02b32df4808ba20c43f59251ec1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:18.940362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9961b-4a93-4519-a0de-f35833c1562e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:18.940644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9961b-4a93-4519-a0de-f35833c1562e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:18.940916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9961b-4a93-4519-a0de-f35833c1562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:18.988023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-9ef9961b-4a93-4519-a0de-f35833c1562e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:18.989219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9ef9961b-4a93-4519-a0de-f35833c1562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:18.996228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83509df-1bbc-44de-a87b-b10b4a528d51 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.076540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.077249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.077536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.077811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.080368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.083122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.083484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1018/2046] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:19.095774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.095774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.095774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.108575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1029/2047] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:19.110313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.121582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af28f4-6096-4408-9ed8-197d39992c0e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.131414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:19.132180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.133143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:19.133241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.133241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.133459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] PATH_INFO: `/v3/projects/e0c890b80c764498a53aa7c97e66c84e/users/b512f4df76d148369d6af74d0560ca7f/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.146902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1019/2048] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:19.147822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.149697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:19.154761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c890b80c764498a53aa7c97e66c84e, user_id=b512f4df76d148369d6af74d0560ca7f, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.161961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.167778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235a51-05ab-463b-ac3d-6dc714a90fc2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.173428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.174149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.174500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.174952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] PATH_INFO: `/v3/users/c21b6122414c4af39efe38187f82940d` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.176314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21b6122414c4af39efe38187f82940d)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.178418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.277048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1030/2049] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:19 2022] PUT /identity/v3/projects/e0c890b80c764498a53aa7c97e66c84e/users/b512f4df76d148369d6af74d0560ca7f/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:19.286941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.357227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b90fc-6b65-4f32-9547-7d930d7b5e31 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.367716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f6f6f-e19b-4086-bf68-c11871f23207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.368326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f6f6f-e19b-4086-bf68-c11871f23207 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.368665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f6f6f-e19b-4086-bf68-c11871f23207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.368941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f6f6f-e19b-4086-bf68-c11871f23207 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.369594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f6f6f-e19b-4086-bf68-c11871f23207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:19.370089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f6f6f-e19b-4086-bf68-c11871f23207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.371810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f6f6f-e19b-4086-bf68-c11871f23207 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.384549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1031/2050] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:19.385761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.386044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.386318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.417796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21b6122414c4af39efe38187f82940d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:19.420435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] MFA Rules not processed for user `b512f4df76d148369d6af74d0560ca7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:19.422069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:19.437203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21b6122414c4af39efe38187f82940d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:19.447668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21b6122414c4af39efe38187f82940d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:19.448426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21b6122414c4af39efe38187f82940d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:19.449066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21b6122414c4af39efe38187f82940d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:19.494246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1032/2051] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:19.494246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.494246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:19.506852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71665f-2f59-4ba7-8b1a-3831363d49b2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.511701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.512273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.512553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.512826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.513456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.515395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.529351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1020/2052] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:19 2022] DELETE /identity/v3/users/c21b6122414c4af39efe38187f82940d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:19.532474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.533421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:19.598856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5aae8-f58c-40d4-aeb4-6c703e261b2c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.603529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0b02e-94c4-4ab9-8ec5-ffb9e1d1d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.604130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0b02e-94c4-4ab9-8ec5-ffb9e1d1d1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.604406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0b02e-94c4-4ab9-8ec5-ffb9e1d1d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.604676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0b02e-94c4-4ab9-8ec5-ffb9e1d1d1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.605304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0b02e-94c4-4ab9-8ec5-ffb9e1d1d1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.607337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0b02e-94c4-4ab9-8ec5-ffb9e1d1d1ea admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.619783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1033/2053] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:19 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:19.620608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.622434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:19.682551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1021/2054] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:19 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:19.685962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80531fb-640b-47d7-baf8-5af83b24da44 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.686944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78bdea-7afc-469e-aa13-782ca84cf5a4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.687490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78bdea-7afc-469e-aa13-782ca84cf5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.688907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78bdea-7afc-469e-aa13-782ca84cf5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.708739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5a78bdea-7afc-469e-aa13-782ca84cf5a4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:19.709952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5a78bdea-7afc-469e-aa13-782ca84cf5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:19.744173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.745005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.745280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.745577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] PATH_INFO: `/v3/projects/d398e29f6bb54e08b9f539a96dca7c89` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.746716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d398e29f6bb54e08b9f539a96dca7c89)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.748801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.769500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1022/2055] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:19.772064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78bdea-7afc-469e-aa13-782ca84cf5a4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.785137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78bdea-7afc-469e-aa13-782ca84cf5a4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.790076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.790794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.791074 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.791374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.792081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.794050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:19.866291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd398e29f6bb54e08b9f539a96dca7c89', 'request_id': 'req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:19.872240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd398e29f6bb54e08b9f539a96dca7c89', 'request_id': 'req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:19.930083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1023/2056] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:19 2022] POST /identity/v3/users => generated 304 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:19.930083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:19.937433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94821ef6-376b-4dba-a817-6e4b105a85f7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:19.995077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:19.995717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:19.996042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:19.996315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:19.997060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:19.998972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.002356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd398e29f6bb54e08b9f539a96dca7c89', 'request_id': 'req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:20.023403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] The token cache is being invalidate because project d398e29f6bb54e08b9f539a96dca7c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:20.024080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:20.024384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:20.025902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1034/2057] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:19 2022] DELETE /identity/v3/projects/d398e29f6bb54e08b9f539a96dca7c89 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:20.026855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.028208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.084969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c49dcc-4346-4ba1-bc65-55829a7dbb23 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.088683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c66eab-24d6-42db-a10b-c9e0445d4a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.089279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c66eab-24d6-42db-a10b-c9e0445d4a6d service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.089559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c66eab-24d6-42db-a10b-c9e0445d4a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.089830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c66eab-24d6-42db-a10b-c9e0445d4a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.091575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f0c66eab-24d6-42db-a10b-c9e0445d4a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.103067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c66eab-24d6-42db-a10b-c9e0445d4a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.104543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c66eab-24d6-42db-a10b-c9e0445d4a6d service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.110173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1024/2058] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:19 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:20.111041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.112557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.114704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1035/2059] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:20.116036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.116320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.116592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.124989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34da6-68e0-4a2c-99b3-0299bd6ddefc admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.134061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4bf6e-22a7-4818-9d04-fe5fc6851abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.134694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4bf6e-22a7-4818-9d04-fe5fc6851abc admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.134957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4bf6e-22a7-4818-9d04-fe5fc6851abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.135257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4bf6e-22a7-4818-9d04-fe5fc6851abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.136016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4bf6e-22a7-4818-9d04-fe5fc6851abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.144530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4bf6e-22a7-4818-9d04-fe5fc6851abc admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.149331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:20.151123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.161726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1036/2060] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:20.162705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.164034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.167119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1025/2061] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:20.176781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219478-cc7a-4637-ba4a-d7cc07b523bf None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.176944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a7b4c-95a6-4758-818d-ebdace3bfd40 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.177155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a7b4c-95a6-4758-818d-ebdace3bfd40 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.178403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a7b4c-95a6-4758-818d-ebdace3bfd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.183549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.184096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.184372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.184637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.185284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.188153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.210298 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1037/2062] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:20.211798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.223908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1f5a7b4c-95a6-4758-818d-ebdace3bfd40 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:20.225460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1f5a7b4c-95a6-4758-818d-ebdace3bfd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.227468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b12fd3-8c86-46ea-b816-730b31296f14 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.231318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:20.239803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.241570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.243287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.243568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.244244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.245815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.251544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1026/2063] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:20.252718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a7b4c-95a6-4758-818d-ebdace3bfd40 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.263318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a7b4c-95a6-4758-818d-ebdace3bfd40 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.264869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1038/2064] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:20.264869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.271415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.271415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.271415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.271415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] PATH_INFO: `/v3/projects/5d8c1838ddfe4cb9b85ff23acec0334c/users/f95086ceff6040cdafae5c1f822bb233/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.277732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899e46-f846-4fc9-8417-0ad9f78b257a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.282772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.283402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.283683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.283952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.284598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:20.284912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.286591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.286707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8c1838ddfe4cb9b85ff23acec0334c, user_id=f95086ceff6040cdafae5c1f822bb233, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.289460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.301121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1039/2065] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:20.302009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.315223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b436e-71c0-4966-9626-c95729e42cd0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.319967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.320588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.320864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.321137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] PATH_INFO: `/v3/projects/9dfa8ecbe62545d694d83925179d2edc/users/bf7efc51acde4da882d069ab5dc1b178/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.335814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa8ecbe62545d694d83925179d2edc, user_id=bf7efc51acde4da882d069ab5dc1b178, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.338461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.413803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:20.426995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1027/2066] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:20 2022] PUT /identity/v3/projects/5d8c1838ddfe4cb9b85ff23acec0334c/users/f95086ceff6040cdafae5c1f822bb233/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:20.427973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.442019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1040/2067] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:20 2022] PUT /identity/v3/projects/9dfa8ecbe62545d694d83925179d2edc/users/bf7efc51acde4da882d069ab5dc1b178/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:20.451712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.532115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4fca0-35c1-4c19-b856-8bceb11e1015 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.539446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4dbf-a1eb-41a5-8878-bfa1b0b72cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.540303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4dbf-a1eb-41a5-8878-bfa1b0b72cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.540668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4dbf-a1eb-41a5-8878-bfa1b0b72cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.541012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4dbf-a1eb-41a5-8878-bfa1b0b72cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.541866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4dbf-a1eb-41a5-8878-bfa1b0b72cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.543592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4dbf-a1eb-41a5-8878-bfa1b0b72cb2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.545306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2665-4463-4447-a01b-af2c04ae4c2a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.558192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.560207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1041/2068] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:20.560324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.560324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.560324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.560548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7abed-ea31-46b6-974a-70bcc3d2a3db None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.560548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7abed-ea31-46b6-974a-70bcc3d2a3db None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.560787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7abed-ea31-46b6-974a-70bcc3d2a3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.561894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.565057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.613922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b5f7abed-ea31-46b6-974a-70bcc3d2a3db None None] MFA Rules not processed for user `bf7efc51acde4da882d069ab5dc1b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:20.615309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b5f7abed-ea31-46b6-974a-70bcc3d2a3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.681232 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1042/2069] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:20.682067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7abed-ea31-46b6-974a-70bcc3d2a3db None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.686413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1028/2070] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:20 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:20.686413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.693841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7abed-ea31-46b6-974a-70bcc3d2a3db None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.761981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470802b-1a20-446e-ad40-47c31a561303 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.766833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.767465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.767766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.768042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.768670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.770584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.770817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.771523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.771849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.772216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] PATH_INFO: `/v3/projects/5d8c1838ddfe4cb9b85ff23acec0334c/users/f95086ceff6040cdafae5c1f822bb233/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.774331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8c1838ddfe4cb9b85ff23acec0334c, user_id=f95086ceff6040cdafae5c1f822bb233, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.777103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.788055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1043/2071] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:20 2022] PUT /identity/v3/projects/5d8c1838ddfe4cb9b85ff23acec0334c/users/f95086ceff6040cdafae5c1f822bb233/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:20.788890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.854130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1029/2072] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:20 2022] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:20.855400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:20.855966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26e812-844b-4fff-869f-8eb8dfc33d73 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.857427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:20.934441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8fd10-282f-4497-8fd0-6e916ae19bca admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:20.934730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e936a2-f01d-410a-acc2-c1972231cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.935586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e936a2-f01d-410a-acc2-c1972231cb21 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.936065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e936a2-f01d-410a-acc2-c1972231cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.936570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e936a2-f01d-410a-acc2-c1972231cb21 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.938262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e936a2-f01d-410a-acc2-c1972231cb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.940711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e936a2-f01d-410a-acc2-c1972231cb21 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:20.943243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:20.944058 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:20.944274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:20.944545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] PATH_INFO: `/v3/projects/2c9e56792b6f467e8ad6c6927095027f` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:20.945695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9e56792b6f467e8ad6c6927095027f)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:20.947844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.053668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1044/2073] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:20 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:21.055023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0ba8-896a-4a65-b641-5dbe88368ade None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.055333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0ba8-896a-4a65-b641-5dbe88368ade None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.055603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0ba8-896a-4a65-b641-5dbe88368ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.083749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-adde0ba8-896a-4a65-b641-5dbe88368ade None None] MFA Rules not processed for user `f95086ceff6040cdafae5c1f822bb233`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:21.083942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9e56792b6f467e8ad6c6927095027f', 'request_id': 'req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.084951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-adde0ba8-896a-4a65-b641-5dbe88368ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.090186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9e56792b6f467e8ad6c6927095027f', 'request_id': 'req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.152411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1045/2074] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:21.153364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0ba8-896a-4a65-b641-5dbe88368ade None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.164172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9e56792b6f467e8ad6c6927095027f', 'request_id': 'req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.175862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] The token cache is being invalidate because project 2c9e56792b6f467e8ad6c6927095027f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:21.176169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.176863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.178365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1030/2075] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:20 2022] DELETE /identity/v3/projects/2c9e56792b6f467e8ad6c6927095027f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:21.179122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.180460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.216523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0ba8-896a-4a65-b641-5dbe88368ade None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.221434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.222042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.222370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.222759 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.223370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.225332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.245666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f8f6c-da0d-4d9d-8a63-f24c5690175b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.250694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.251377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.251673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.252720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.252871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.254517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.264396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1031/2076] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:21.265191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.267350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.270975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:21.323350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7138b6-0363-4a84-8b4f-a60d2916cb0b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.326940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.327575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.327854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.328129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.330416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.339508 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1046/2077] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:21 2022] POST /identity/v3/users => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:21.340467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.342299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.355058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2783d46-d40c-4a09-88a9-4b39958097b9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.359816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.360437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.360719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.360996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] PATH_INFO: `/v3/users/101cdee97db14a4e9cdb1a6392bc8e7b` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.362111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=101cdee97db14a4e9cdb1a6392bc8e7b)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.364083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.394115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.395595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.404397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1032/2078] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:21.405255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.415136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd77fdb-381c-414a-ae87-d8d7b02726be service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.419810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.420390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.420739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.421012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.421642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.423228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.433397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1033/2079] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:21.434265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.438361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.450819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e29936-2768-4130-b607-f70649e9c351 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.456235 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.456839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.457167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.457397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.458022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.459648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.470308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1034/2080] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:21.471198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.480958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686550ee-3bc2-4cb6-a75e-c44bff347933 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.482719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:21.485763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.486417 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.486686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.486956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] PATH_INFO: `/v3/projects/81de43205f3b4f4e945c4acc90ad41ad/users/198ae0ff622d49e6bdc5a044c1bd2e2d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.502459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81de43205f3b4f4e945c4acc90ad41ad, user_id=198ae0ff622d49e6bdc5a044c1bd2e2d, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.505134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.580127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101cdee97db14a4e9cdb1a6392bc8e7b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.581017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101cdee97db14a4e9cdb1a6392bc8e7b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.589349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101cdee97db14a4e9cdb1a6392bc8e7b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.613780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1035/2081] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:21 2022] PUT /identity/v3/projects/81de43205f3b4f4e945c4acc90ad41ad/users/198ae0ff622d49e6bdc5a044c1bd2e2d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:21.614638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.656039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:21.678930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a8a18-95dd-4ade-9869-d31d78a89481 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.681228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101cdee97db14a4e9cdb1a6392bc8e7b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.683924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.684619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.684903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.685371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] PATH_INFO: `/v3/projects/e38ae53a711f4aef80e5862b931443e1/users/bb4132f9adc54bcba5bf769b6bebeed0/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.696694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-4381563d-994a-4b4a-b710-045e5e5d3b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101cdee97db14a4e9cdb1a6392bc8e7b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:21.703449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1047/2082] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:21 2022] DELETE /identity/v3/users/101cdee97db14a4e9cdb1a6392bc8e7b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:21.704303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38ae53a711f4aef80e5862b931443e1, user_id=bb4132f9adc54bcba5bf769b6bebeed0, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.705285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.705661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.706031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.709104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.734398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] MFA Rules not processed for user `198ae0ff622d49e6bdc5a044c1bd2e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:21.736256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.801424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1048/2083] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:21.802365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.803966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.860806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc871a-962e-466f-9653-0a1785f29766 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.864648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.865251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.865525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.865790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.867579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.876999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1036/2084] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:21 2022] PUT /identity/v3/projects/e38ae53a711f4aef80e5862b931443e1/users/bb4132f9adc54bcba5bf769b6bebeed0/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:21.878133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.879883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.934281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.935752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.942454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de98a-97bc-473b-9e36-1ccb051cc5a8 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:21.946306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1049/2085] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:21.947107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:21.947342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:21.947799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:21.948064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:21.948358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:21.948658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:21.948985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:21.950930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:21.998394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:22.026484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ccc7-7e8f-4f2b-9315-815348f9134a service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.031317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.032016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.032234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.032523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.033168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.034849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.047580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1050/2086] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:22.051375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.059267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1037/2087] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:21 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:22.065141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61bf1f-7adc-481a-bb03-d15d3af5612d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.065627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.135033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5e809-4ced-4ed1-94ce-57a79be1af2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.135453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e809-4ced-4ed1-94ce-57a79be1af2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.135921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e809-4ced-4ed1-94ce-57a79be1af2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.136447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e809-4ced-4ed1-94ce-57a79be1af2e admin admin] PATH_INFO: `/v3/projects/e38ae53a711f4aef80e5862b931443e1/users/bb4132f9adc54bcba5bf769b6bebeed0/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.154909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5e809-4ced-4ed1-94ce-57a79be1af2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38ae53a711f4aef80e5862b931443e1, user_id=bb4132f9adc54bcba5bf769b6bebeed0, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.159788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5e809-4ced-4ed1-94ce-57a79be1af2e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.182406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1051/2088] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:22 2022] PUT /identity/v3/projects/e38ae53a711f4aef80e5862b931443e1/users/bb4132f9adc54bcba5bf769b6bebeed0/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:22.184972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.185334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.186001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.219633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] MFA Rules not processed for user `bb4132f9adc54bcba5bf769b6bebeed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:22.224287 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7d11b-3815-4ff1-ad3d-33d419c1685d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.224658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:22.290133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.290859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.291233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.291853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.292533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.294804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.339327 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1052/2089] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:22.340314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.342580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:22.359553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1084f-453e-4bef-8fb6-8207e38da073 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.364760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.365408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.365688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.365964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] PATH_INFO: `/v3/projects/ee14cc6c69c144a58120cd2b567fa436` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.367237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee14cc6c69c144a58120cd2b567fa436)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.369303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.425122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1038/2090] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:22 2022] POST /identity/v3/users => generated 297 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:22.428096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.428096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:22.486642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c592d2b-8de6-46a7-9b1d-4d57bb66ec65 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.494354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.515241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.515241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.515241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.515241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.515241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.519559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1039/2091] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:22.520358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.530833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81b4da-2b0f-4ce8-aff5-573f5a71d5cc service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.535490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.536091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.536368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.536642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.537433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.539292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.552225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1040/2092] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:22.577856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee14cc6c69c144a58120cd2b567fa436', 'request_id': 'req-328d81bd-dd5d-4605-9d21-05d051b9c5b4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:22.577856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee14cc6c69c144a58120cd2b567fa436', 'request_id': 'req-328d81bd-dd5d-4605-9d21-05d051b9c5b4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:22.581321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.591498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08e193-d0c6-44c9-9e4c-3b2eb3336aec admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.647788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.648440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.648718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.648989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] PATH_INFO: `/v3/projects/6cec37231b2840089cc4fb4c9ce39521/users/8e237af005b747d685b1683e480b8cf7/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.662804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cec37231b2840089cc4fb4c9ce39521, user_id=8e237af005b747d685b1683e480b8cf7, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.665570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.881158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee14cc6c69c144a58120cd2b567fa436', 'request_id': 'req-328d81bd-dd5d-4605-9d21-05d051b9c5b4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:22.888462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1041/2093] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:22 2022] PUT /identity/v3/projects/6cec37231b2840089cc4fb4c9ce39521/users/8e237af005b747d685b1683e480b8cf7/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:22.892979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.895227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] The token cache is being invalidate because project ee14cc6c69c144a58120cd2b567fa436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:22.895227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:22.895227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-328d81bd-dd5d-4605-9d21-05d051b9c5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:22.895820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1053/2094] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:22 2022] DELETE /identity/v3/projects/ee14cc6c69c144a58120cd2b567fa436 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:22.902865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab583b2-6ecc-4699-9ec5-ffcd597edaba None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.903148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab583b2-6ecc-4699-9ec5-ffcd597edaba None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.903464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab583b2-6ecc-4699-9ec5-ffcd597edaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.923726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8ab583b2-6ecc-4699-9ec5-ffcd597edaba None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:22.924985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8ab583b2-6ecc-4699-9ec5-ffcd597edaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:22.958924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207c04c-5316-4ca0-b924-8811135a638c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:22.963673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:22.964655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.964932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.965198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.965852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:22.967750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:22.978999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1042/2095] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:22.984003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:22.984825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:22.988887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1054/2096] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:22.997013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a73e-a025-4d17-acfe-5387161783aa None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:22.997156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a73e-a025-4d17-acfe-5387161783aa None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:22.997426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a73e-a025-4d17-acfe-5387161783aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:22.999691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7b906-9445-4c33-82e5-15c7e8db5338 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.005290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71214783-cb14-4b75-9f37-52f7e015c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.005938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71214783-cb14-4b75-9f37-52f7e015c206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.006217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71214783-cb14-4b75-9f37-52f7e015c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.006491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71214783-cb14-4b75-9f37-52f7e015c206 admin admin] PATH_INFO: `/v3/projects/6cec37231b2840089cc4fb4c9ce39521/users/8e237af005b747d685b1683e480b8cf7/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.008443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71214783-cb14-4b75-9f37-52f7e015c206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cec37231b2840089cc4fb4c9ce39521, user_id=8e237af005b747d685b1683e480b8cf7, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.011102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71214783-cb14-4b75-9f37-52f7e015c206 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.022998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f303a73e-a025-4d17-acfe-5387161783aa None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:23.023953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f303a73e-a025-4d17-acfe-5387161783aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:23.024157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1043/2097] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:22 2022] PUT /identity/v3/projects/6cec37231b2840089cc4fb4c9ce39521/users/8e237af005b747d685b1683e480b8cf7/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:23.034222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094872b-22f9-4088-ba2a-c3829be3359b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.034506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094872b-22f9-4088-ba2a-c3829be3359b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.034771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094872b-22f9-4088-ba2a-c3829be3359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.075808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d094872b-22f9-4088-ba2a-c3829be3359b None None] MFA Rules not processed for user `8e237af005b747d685b1683e480b8cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:23.077184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d094872b-22f9-4088-ba2a-c3829be3359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:23.110000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1055/2098] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:23.114901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a73e-a025-4d17-acfe-5387161783aa None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.128817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a73e-a025-4d17-acfe-5387161783aa None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.134749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.135643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.136111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.136574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.137406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:23.137858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.147452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.156727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1056/2099] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:48:23.158364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.161142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:23.182835 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1044/2100] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:23.184301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094872b-22f9-4088-ba2a-c3829be3359b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.198225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094872b-22f9-4088-ba2a-c3829be3359b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.208941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.210651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.211011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.211392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.212120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.215380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.233139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efca21-addb-4b03-b8a1-431dbf8b1f78 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.238137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.247448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.247448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.247448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.247448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:23.307849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.309363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.321150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1057/2101] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:23 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:23.327851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.327851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:23.340574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a803e-c6f2-4518-b8c4-7d2bd8796af4 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.346019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.346630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.346908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.347253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.370801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1045/2102] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:23 2022] POST /identity/v3/projects => generated 391 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:23.370948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.371038 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.371827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.391004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1058/2103] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:23.474125 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092da3c-f84a-49fe-a045-658fc11dab03 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.479479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.480103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.480381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.480654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.481297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.483516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.619368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1046/2104] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:23 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:23.623116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.631722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43b007-74e1-4a84-a059-32cdcbc075e3 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.636329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.636920 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.637199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.637472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.638106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.639790 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.649921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1059/2105] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:23.658013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.668387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cb118-d546-43a3-b7cb-ab517ce08a0b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.674166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.674761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.675040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.675347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.675989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.677592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.691124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1047/2106] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:23.692553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.702765 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d7705-7a4c-466d-9c2b-7acd31204244 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.707090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5afe88-7ea3-4677-b67b-d00f6131bfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.707771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5afe88-7ea3-4677-b67b-d00f6131bfc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.708049 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5afe88-7ea3-4677-b67b-d00f6131bfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.708404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5afe88-7ea3-4677-b67b-d00f6131bfc2 admin admin] PATH_INFO: `/v3/projects/f67ea65abe494670bb364a482df295d1/users/c0ea59b1c7434d98898cd5954b3b4175/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.724893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5afe88-7ea3-4677-b67b-d00f6131bfc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67ea65abe494670bb364a482df295d1, user_id=c0ea59b1c7434d98898cd5954b3b4175, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.727603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5afe88-7ea3-4677-b67b-d00f6131bfc2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:23.763221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:23.797209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1060/2107] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:23 2022] PUT /identity/v3/projects/f67ea65abe494670bb364a482df295d1/users/c0ea59b1c7434d98898cd5954b3b4175/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:23.809210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033762a-5665-4629-a58a-e5b0c16d0c3e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.809535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033762a-5665-4629-a58a-e5b0c16d0c3e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.809755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033762a-5665-4629-a58a-e5b0c16d0c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.819752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafa851-c4bf-448f-83a5-3f31eaa2e7e9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:23.851543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4033762a-5665-4629-a58a-e5b0c16d0c3e None None] MFA Rules not processed for user `c0ea59b1c7434d98898cd5954b3b4175`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:23.852857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4033762a-5665-4629-a58a-e5b0c16d0c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:23.892266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:23.893200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:23.893485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:23.893903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:23.896340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:23.943235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1061/2108] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:23.976881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:23.978439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:24.003124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1048/2109] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:24.030295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:24.036633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033762a-5665-4629-a58a-e5b0c16d0c3e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:24.053124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033762a-5665-4629-a58a-e5b0c16d0c3e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:24.068528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d1540-61f3-48fb-952a-e05cce68e0a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:24.069356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1540-61f3-48fb-952a-e05cce68e0a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:24.072176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1540-61f3-48fb-952a-e05cce68e0a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:24.072176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1540-61f3-48fb-952a-e05cce68e0a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:24.088223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:24.091393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d1540-61f3-48fb-952a-e05cce68e0a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:24.092940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d1540-61f3-48fb-952a-e05cce68e0a6 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:24.106122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1062/2110] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:24.734042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:24.808233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076acef-34fc-4ccb-8a7f-aef64726a4e7 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:24.820082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766528e-2655-4824-82f0-00694368471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:24.820082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766528e-2655-4824-82f0-00694368471a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:24.820082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766528e-2655-4824-82f0-00694368471a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:24.820082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766528e-2655-4824-82f0-00694368471a admin admin] PATH_INFO: `/v3/users/198ae0ff622d49e6bdc5a044c1bd2e2d` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:24.820446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766528e-2655-4824-82f0-00694368471a admin admin] RBAC: Authorizing `identity:delete_user(user_id=198ae0ff622d49e6bdc5a044c1bd2e2d)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:24.820446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766528e-2655-4824-82f0-00694368471a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:25.046013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198ae0ff622d49e6bdc5a044c1bd2e2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:25.058627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198ae0ff622d49e6bdc5a044c1bd2e2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:25.066391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198ae0ff622d49e6bdc5a044c1bd2e2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:25.067083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198ae0ff622d49e6bdc5a044c1bd2e2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:25.067715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198ae0ff622d49e6bdc5a044c1bd2e2d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:25.145250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1049/2111] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:24 2022] DELETE /identity/v3/users/198ae0ff622d49e6bdc5a044c1bd2e2d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:25.149504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:25.149990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:25.150263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:25.184083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:25.185577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:25.262585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1063/2112] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:25.273241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:25.274755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:25.346545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766528e-2655-4824-82f0-00694368471a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:25.348497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:25.349149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:25.349429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:25.349706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:25.360535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:25.366425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:25.373368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1050/2113] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:25.385475 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:25.579949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:25.900653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:25.906480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:25.919330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52c6d-80f6-4032-bffb-bad422f6a399 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:25.949894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:25.950704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:25.950997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:25.951320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] PATH_INFO: `/v3/projects/81de43205f3b4f4e945c4acc90ad41ad` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:25.952531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81de43205f3b4f4e945c4acc90ad41ad)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:25.955192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:26.117194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81de43205f3b4f4e945c4acc90ad41ad', 'request_id': 'req-39f0af0d-9ead-4700-9d27-25d659541ec2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.122892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81de43205f3b4f4e945c4acc90ad41ad', 'request_id': 'req-39f0af0d-9ead-4700-9d27-25d659541ec2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.247503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81de43205f3b4f4e945c4acc90ad41ad', 'request_id': 'req-39f0af0d-9ead-4700-9d27-25d659541ec2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.261776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] The token cache is being invalidate because project 81de43205f3b4f4e945c4acc90ad41ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:26.262073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.262795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.264576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1064/2114] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:25 2022] DELETE /identity/v3/projects/81de43205f3b4f4e945c4acc90ad41ad => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:26.268660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:26.278327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c336c-323b-4368-bf6a-2e7242194605 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:26.344220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:26.344855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:26.345130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:26.345404 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] PATH_INFO: `/v3/users/8e237af005b747d685b1683e480b8cf7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:26.346599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e237af005b747d685b1683e480b8cf7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:26.348600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:26.564076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e237af005b747d685b1683e480b8cf7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.575770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e237af005b747d685b1683e480b8cf7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.582476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e237af005b747d685b1683e480b8cf7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.588358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e237af005b747d685b1683e480b8cf7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.588358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ea5f0535-390f-42a1-93e5-c2625de3c2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e237af005b747d685b1683e480b8cf7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:26.676302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1051/2115] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:26 2022] DELETE /identity/v3/users/8e237af005b747d685b1683e480b8cf7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:27.193088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:27.194746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:27.214963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0af0d-9ead-4700-9d27-25d659541ec2 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:27.273617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:27.274351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:27.274546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:27.275087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] PATH_INFO: `/v3/projects/6cec37231b2840089cc4fb4c9ce39521` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:27.276377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cec37231b2840089cc4fb4c9ce39521)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:27.278942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:27.454483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cec37231b2840089cc4fb4c9ce39521', 'request_id': 'req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:27.460048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cec37231b2840089cc4fb4c9ce39521', 'request_id': 'req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:27.555325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cec37231b2840089cc4fb4c9ce39521', 'request_id': 'req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:27.567654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] The token cache is being invalidate because project 6cec37231b2840089cc4fb4c9ce39521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:27.569541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:27.569541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cc3cf7b1-5f05-4957-8b1c-ce03376c3e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:27.570099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1065/2116] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:27 2022] DELETE /identity/v3/projects/6cec37231b2840089cc4fb4c9ce39521 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:27.574899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218e4e4-2808-400d-9377-62bfce5a9269 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:27.575402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218e4e4-2808-400d-9377-62bfce5a9269 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:27.575602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218e4e4-2808-400d-9377-62bfce5a9269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:27.596123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:27.600590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-f218e4e4-2808-400d-9377-62bfce5a9269 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:27.604337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f218e4e4-2808-400d-9377-62bfce5a9269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:27.678946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1052/2117] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:27.685766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e9e67-55ac-447a-88df-caa622fcf0fd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:27.686056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e9e67-55ac-447a-88df-caa622fcf0fd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:27.686329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e9e67-55ac-447a-88df-caa622fcf0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:27.708638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-421e9e67-55ac-447a-88df-caa622fcf0fd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:27.713175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-421e9e67-55ac-447a-88df-caa622fcf0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:27.718848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1066/2118] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:27.723013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218e4e4-2808-400d-9377-62bfce5a9269 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:27.732966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218e4e4-2808-400d-9377-62bfce5a9269 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:27.738420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:27.741913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:27.741913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:27.741913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:27.741913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:27.741913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:27.742420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:27.754921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1053/2119] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:27.759337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e9e67-55ac-447a-88df-caa622fcf0fd None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:27.768677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e9e67-55ac-447a-88df-caa622fcf0fd None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:27.773586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:27.774181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:27.781921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:27.781921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:27.781921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:27.781921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:27.911578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1067/2120] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:27 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:27.912957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:27.923601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc312e-1bd5-43b0-9b6a-4d65383fc949 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:27.982114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:27.982644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:27.982937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:27.983240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:27.983863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:27.986684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:28.116330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1054/2121] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:27 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:28.120459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:28.130786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa3aaf-83a6-4a57-bd72-6b1ef09e0171 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:28.135726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:28.136279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:28.136560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:28.136830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:28.137482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:28.139184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:28.152206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1068/2122] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:28.153638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:28.189642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9541f-248b-4ecc-9e20-cd77cd6cc3c7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:28.194638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82556002-6b15-4666-807a-1f538a24d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:28.195274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82556002-6b15-4666-807a-1f538a24d7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:28.195553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82556002-6b15-4666-807a-1f538a24d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:28.195828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82556002-6b15-4666-807a-1f538a24d7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:28.196728 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82556002-6b15-4666-807a-1f538a24d7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:28.198474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82556002-6b15-4666-807a-1f538a24d7c3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:28.211473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1055/2123] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:28.216612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:28.241780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:28.248902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7be5f-e176-413d-847b-2dfb4c195a5b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:28.256388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:28.257598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:28.258154 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:28.258611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] PATH_INFO: `/v3/projects/cd746256b1d7472f81df994328df2ed2/users/9a6971ea37b943708a1f9dc3509fc7b1/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:28.289493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd746256b1d7472f81df994328df2ed2, user_id=9a6971ea37b943708a1f9dc3509fc7b1, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:28.292579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:28.383811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1069/2124] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:28 2022] PUT /identity/v3/projects/cd746256b1d7472f81df994328df2ed2/users/9a6971ea37b943708a1f9dc3509fc7b1/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:28.401276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:28.401563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:28.401836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:28.431928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] MFA Rules not processed for user `9a6971ea37b943708a1f9dc3509fc7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:28.433148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:28.497875 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1056/2125] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:28.509630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:28.511471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:28.595481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82921b4-3915-4740-a12c-27759ff9f287 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:28.599492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:28.600191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:28.600547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:28.600706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:28.610308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:28.612103 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:28.622364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1070/2126] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:29.441954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:29.688498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:30.310230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:30.683752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:30.685241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:30.755916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb596f-e7ad-47de-9e4d-7f3e3191036b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:30.760651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b1023-dfff-412d-9450-11522bdfbfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:30.761357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b1023-dfff-412d-9450-11522bdfbfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:30.761568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b1023-dfff-412d-9450-11522bdfbfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:30.762127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b1023-dfff-412d-9450-11522bdfbfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:30.763622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-076b1023-dfff-412d-9450-11522bdfbfa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:30.823363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:30.845890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b1023-dfff-412d-9450-11522bdfbfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:30.847401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b1023-dfff-412d-9450-11522bdfbfa8 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:30.857347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1057/2127] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:30.933573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:31.871532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:31.958156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:32.532734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:32.537473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:32.630331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818287b-454d-450e-9770-0ef69a3ba900 service glance] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:32.634851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:32.635519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:32.635838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:32.636107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] PATH_INFO: `/v3/users/bf7efc51acde4da882d069ab5dc1b178` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:32.637258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7efc51acde4da882d069ab5dc1b178)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:32.639270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:32.796159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:32.820241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7efc51acde4da882d069ab5dc1b178'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:32.821336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7efc51acde4da882d069ab5dc1b178'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:32.830989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7efc51acde4da882d069ab5dc1b178'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:32.976380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7efc51acde4da882d069ab5dc1b178'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:32.991956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7efc51acde4da882d069ab5dc1b178'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:32.998173 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1071/2128] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:32 2022] DELETE /identity/v3/users/bf7efc51acde4da882d069ab5dc1b178 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:33.004392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:33.004905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:33.005108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:33.025641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:33.026859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:33.089483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1058/2129] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:33.099419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:33.100824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:33.139055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:33.157895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51e8d-8c33-4eb9-b439-62682d49c4e4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:33.162089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:33.162468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:33.162659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:33.162897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:33.173975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:33.175499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:33.186377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1072/2130] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:33.801560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:33.803487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:33.823353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28979aca-b5fe-4c97-ab90-e70c324bd732 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:33.833982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878a344-0431-446b-951c-35c2284114da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:33.834807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878a344-0431-446b-951c-35c2284114da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:33.835270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878a344-0431-446b-951c-35c2284114da admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:33.835710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878a344-0431-446b-951c-35c2284114da admin admin] PATH_INFO: `/v3/projects/9dfa8ecbe62545d694d83925179d2edc` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:33.837032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878a344-0431-446b-951c-35c2284114da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfa8ecbe62545d694d83925179d2edc)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:33.839102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878a344-0431-446b-951c-35c2284114da admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:33.916471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:34.001471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfa8ecbe62545d694d83925179d2edc', 'request_id': 'req-2878a344-0431-446b-951c-35c2284114da'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.008956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfa8ecbe62545d694d83925179d2edc', 'request_id': 'req-2878a344-0431-446b-951c-35c2284114da'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.028636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:34.030113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:34.049532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd6b80-a3b4-496b-963a-10303c6e0da1 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:34.096855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfa8ecbe62545d694d83925179d2edc', 'request_id': 'req-2878a344-0431-446b-951c-35c2284114da'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.112403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2878a344-0431-446b-951c-35c2284114da admin admin] The token cache is being invalidate because project 9dfa8ecbe62545d694d83925179d2edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:34.113042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.113934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.115810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1059/2131] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:33 2022] DELETE /identity/v3/projects/9dfa8ecbe62545d694d83925179d2edc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:34.120019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:34.122336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:34.155472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:34.156005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:34.158259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:34.159110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] PATH_INFO: `/v3/users/ca168b3b94bb4e7584390e84f4d3de42` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:34.160870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca168b3b94bb4e7584390e84f4d3de42)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:34.162840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:34.228974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878a344-0431-446b-951c-35c2284114da admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:34.232379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:34.233088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:34.233381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:34.233719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] PATH_INFO: `/v3/users/bb4132f9adc54bcba5bf769b6bebeed0` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:34.237154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4132f9adc54bcba5bf769b6bebeed0)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:34.239298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:34.481303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4132f9adc54bcba5bf769b6bebeed0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.486642 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca168b3b94bb4e7584390e84f4d3de42'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.487344 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca168b3b94bb4e7584390e84f4d3de42'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.497383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca168b3b94bb4e7584390e84f4d3de42'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.508844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4132f9adc54bcba5bf769b6bebeed0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.526767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4132f9adc54bcba5bf769b6bebeed0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.526960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4132f9adc54bcba5bf769b6bebeed0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.527799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4132f9adc54bcba5bf769b6bebeed0'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.589913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca168b3b94bb4e7584390e84f4d3de42'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.603832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca168b3b94bb4e7584390e84f4d3de42'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:34.610106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1073/2132] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:34 2022] DELETE /identity/v3/users/ca168b3b94bb4e7584390e84f4d3de42 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:34.634141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1060/2133] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:34 2022] DELETE /identity/v3/users/bb4132f9adc54bcba5bf769b6bebeed0 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:34.921935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:34.923713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:34.999891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef176d5-21f6-467e-b510-1292ae10f3ef admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.062517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.063807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.064081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.064447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] PATH_INFO: `/v3/projects/1c72ff1682e542a0bed06fe56b2f65b0` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.065579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c72ff1682e542a0bed06fe56b2f65b0)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.067619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.261166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.263271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:35.280268 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c72ff1682e542a0bed06fe56b2f65b0', 'request_id': 'req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.281063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f48ac-a930-4243-bf05-629be8baba7f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.287883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c72ff1682e542a0bed06fe56b2f65b0', 'request_id': 'req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.339247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.339872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.340144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.340508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] PATH_INFO: `/v3/projects/e38ae53a711f4aef80e5862b931443e1` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.341668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38ae53a711f4aef80e5862b931443e1)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.343723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.356877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:35.384436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c72ff1682e542a0bed06fe56b2f65b0', 'request_id': 'req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.397346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] The token cache is being invalidate because project 1c72ff1682e542a0bed06fe56b2f65b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:35.397686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.398853 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c80d6848-a30d-4e59-9bf1-d70b7f0e29b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.401102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1074/2134] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:34 2022] DELETE /identity/v3/projects/1c72ff1682e542a0bed06fe56b2f65b0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:35.405914 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8fb1-6e46-4c25-9302-7014a9f811fd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.406195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8fb1-6e46-4c25-9302-7014a9f811fd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.406468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8fb1-6e46-4c25-9302-7014a9f811fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.428040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-da6c8fb1-6e46-4c25-9302-7014a9f811fd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:35.429220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-da6c8fb1-6e46-4c25-9302-7014a9f811fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:35.439619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1075/2135] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:35.446940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719bb14-0aad-4388-ab2a-860aa78321fb None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.447252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719bb14-0aad-4388-ab2a-860aa78321fb None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.447522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719bb14-0aad-4388-ab2a-860aa78321fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.466458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6719bb14-0aad-4388-ab2a-860aa78321fb None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:35.467678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6719bb14-0aad-4388-ab2a-860aa78321fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:35.475835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1076/2136] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:35.479780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719bb14-0aad-4388-ab2a-860aa78321fb None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.489633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719bb14-0aad-4388-ab2a-860aa78321fb None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.497853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38ae53a711f4aef80e5862b931443e1', 'request_id': 'req-e5bd9060-3a01-4974-a678-25d51a45ae5e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.507967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38ae53a711f4aef80e5862b931443e1', 'request_id': 'req-e5bd9060-3a01-4974-a678-25d51a45ae5e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.560685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.561255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.561551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.561818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.562498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:35.562983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.565249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.583336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1077/2137] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:48:35.584393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.598878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910c57a-cf2c-489a-a797-50a145131827 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.604600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.605234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.605507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.605806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.606434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.608388 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.635753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38ae53a711f4aef80e5862b931443e1', 'request_id': 'req-e5bd9060-3a01-4974-a678-25d51a45ae5e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.646933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] The token cache is being invalidate because project e38ae53a711f4aef80e5862b931443e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:35.647275 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.647919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e5bd9060-3a01-4974-a678-25d51a45ae5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:35.649406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1061/2138] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:35 2022] DELETE /identity/v3/projects/e38ae53a711f4aef80e5862b931443e1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:35.654103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377d4ce-209f-4281-854c-151ca70ff132 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.654456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377d4ce-209f-4281-854c-151ca70ff132 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.655068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377d4ce-209f-4281-854c-151ca70ff132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.665748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:35.675815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8377d4ce-209f-4281-854c-151ca70ff132 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:35.677010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8377d4ce-209f-4281-854c-151ca70ff132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:35.685159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1062/2139] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:35.692491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f7709-78d1-403f-8054-37e24951bdfc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.692773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f7709-78d1-403f-8054-37e24951bdfc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.693043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f7709-78d1-403f-8054-37e24951bdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.713228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1078/2140] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:35 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:35.713406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a05f7709-78d1-403f-8054-37e24951bdfc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:35.713406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a05f7709-78d1-403f-8054-37e24951bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:35.718041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.720636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:35.785454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1063/2141] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:35.789981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f7709-78d1-403f-8054-37e24951bdfc None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.799846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f7709-78d1-403f-8054-37e24951bdfc None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.805216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.805871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.806165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.806434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.807080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:35.807411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.808997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.809747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e85fc-e5b5-4131-8a10-b31c695d9c94 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.814550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.815149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.815477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.815767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.816444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.818568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.825113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1064/2142] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:48:35.826100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.835934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566b7be-d261-45b7-b2c7-eb0e605f25b1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.840555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.841128 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.841402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.841670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.842286 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.844726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.945497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1079/2143] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:35 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:35.949573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.959641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cafcc-893e-49fd-8420-9fe9e8c55eb7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.964649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.965222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.965497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.965786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.966403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.968013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:35.978357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1080/2144] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:35.982022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:35.991859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162325-57f8-47de-88be-d02ab693117e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:35.996541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:35.997113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:35.997392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:35.997664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:35.998286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:35.999910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.003980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1065/2145] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:35 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:36.009215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.011254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1081/2146] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:36.015245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.025778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c25bc-8687-4ad1-a179-e99543472632 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.071499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abfd8f-cad5-4f99-a684-0be78b9d8910 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.078298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.079482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.079719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.079990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.082813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.083439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163d9e0-f2b9-4bd3-997d-037b75b48e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.084228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d9e0-f2b9-4bd3-997d-037b75b48e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.084512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d9e0-f2b9-4bd3-997d-037b75b48e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.084786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d9e0-f2b9-4bd3-997d-037b75b48e31 admin admin] PATH_INFO: `/v3/projects/f7b1385143d5408ca425f507de5fdf76/users/a9ec9d7971ad4bd5a176bf95e7a2b135/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.084878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.100858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163d9e0-f2b9-4bd3-997d-037b75b48e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b1385143d5408ca425f507de5fdf76, user_id=a9ec9d7971ad4bd5a176bf95e7a2b135, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.103932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163d9e0-f2b9-4bd3-997d-037b75b48e31 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.145412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1066/2147] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:36 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:36.149687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.160104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7ff8-fbf2-4241-99b9-5bb22e54abf2 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.165207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.165781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.166176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.166461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.167099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.168753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.182392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1067/2148] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:36.183459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.190815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1082/2149] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:36 2022] PUT /identity/v3/projects/f7b1385143d5408ca425f507de5fdf76/users/a9ec9d7971ad4bd5a176bf95e7a2b135/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:36.194635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cc999-7460-4d15-9df5-c4b23483e455 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.195846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.196067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.196347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.222886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:36.225045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:36.257915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.271189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.271189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.271189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.271189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.271189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.279345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1068/2150] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:36.283240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.297081 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a972-de08-4f75-badc-089d0319272d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.304172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c246d-c156-4b23-ac19-3a9e0710e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.304826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c246d-c156-4b23-ac19-3a9e0710e29f admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.305122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c246d-c156-4b23-ac19-3a9e0710e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.305582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c246d-c156-4b23-ac19-3a9e0710e29f admin admin] PATH_INFO: `/v3/projects/cb97500f04384007b672db3ec587698b/users/9ee37f36b7964349b55be016de52f18b/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.322732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c246d-c156-4b23-ac19-3a9e0710e29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb97500f04384007b672db3ec587698b, user_id=9ee37f36b7964349b55be016de52f18b, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.326700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c246d-c156-4b23-ac19-3a9e0710e29f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.327703 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1083/2151] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:36.337404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.338809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:36.394870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ec65-be62-4cce-946d-811d9ebf056e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.398643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.399273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.399556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.399835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.411206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.412937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.418706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1069/2152] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:36 2022] PUT /identity/v3/projects/cb97500f04384007b672db3ec587698b/users/9ee37f36b7964349b55be016de52f18b/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:36.425864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1084/2153] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:48:36.437534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553dd43-a722-4e23-87a1-01d33cacf4a7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.439046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553dd43-a722-4e23-87a1-01d33cacf4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.439046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553dd43-a722-4e23-87a1-01d33cacf4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.484473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b553dd43-a722-4e23-87a1-01d33cacf4a7 None None] MFA Rules not processed for user `9ee37f36b7964349b55be016de52f18b`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:36.486560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b553dd43-a722-4e23-87a1-01d33cacf4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:36.553511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1070/2154] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:36.558080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.568270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1c6d-2f53-49dc-af62-f6c6186502f1 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.625462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.626089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.626364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.626704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.627356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.629532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.749676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1085/2155] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:36 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:36.751121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553dd43-a722-4e23-87a1-01d33cacf4a7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.762243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553dd43-a722-4e23-87a1-01d33cacf4a7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.839523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.840118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.840401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.840675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.841395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.843524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.851347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:36.940084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1071/2156] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:36 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:36.944260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.946709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:36.957255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e91a9-119b-4e02-a35f-7c0bcba9e2e6 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.961966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.962626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.962996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.963345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:36.964017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:36.965693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:36.978637 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1086/2157] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:36.982963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:36.993225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fc4e5-a84e-449a-b792-63f02bd10950 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:36.998110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:36.998768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:36.999048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:36.999362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] PATH_INFO: `/v3/projects/0c49723a228f43a98d865f0432fc5c56/users/0ba2d8ea2f9846ce9469442e546e44b1/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:37.015587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c49723a228f43a98d865f0432fc5c56, user_id=0ba2d8ea2f9846ce9469442e546e44b1, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:37.018869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:37.128408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1072/2158] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:36 2022] PUT /identity/v3/projects/0c49723a228f43a98d865f0432fc5c56/users/0ba2d8ea2f9846ce9469442e546e44b1/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:37.132365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:37.142955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03623e3-3835-4d6a-87ce-b30877c2e320 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:37.201447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317de8d-7c24-4776-ab39-f8c83e104cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:37.202060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317de8d-7c24-4776-ab39-f8c83e104cca admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:37.202394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317de8d-7c24-4776-ab39-f8c83e104cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:37.202670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317de8d-7c24-4776-ab39-f8c83e104cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:37.203466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317de8d-7c24-4776-ab39-f8c83e104cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:37.205678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317de8d-7c24-4776-ab39-f8c83e104cca admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:37.216219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1087/2159] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:37.220641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:37.232486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e910-31d3-456e-a94c-836d5dcbc608 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:37.238120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:37.238774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:37.239047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:37.239366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] PATH_INFO: `/v3/projects/0c49723a228f43a98d865f0432fc5c56/users/0ba2d8ea2f9846ce9469442e546e44b1/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:37.241365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c49723a228f43a98d865f0432fc5c56, user_id=0ba2d8ea2f9846ce9469442e546e44b1, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:37.244170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:37.257307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1073/2160] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:37 2022] PUT /identity/v3/projects/0c49723a228f43a98d865f0432fc5c56/users/0ba2d8ea2f9846ce9469442e546e44b1/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:37.269018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:37.269377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:37.269655 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:37.300132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] MFA Rules not processed for user `0ba2d8ea2f9846ce9469442e546e44b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:37.301356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:37.371366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1088/2161] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:37.383200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:37.385060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:37.449116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bbde5-05ab-4e41-b6dd-b79c9bccb5f9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:37.455450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:37.458017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:37.458295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:37.458567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:37.468411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:37.470469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:37.490578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1074/2162] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:48:37.759659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:37.761515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:37.776696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2bc60-7aff-46c4-ae1f-37112628091f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:37.783720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acba39-5641-4a91-b3c3-154a0b49c7d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:37.784379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acba39-5641-4a91-b3c3-154a0b49c7d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:37.784619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acba39-5641-4a91-b3c3-154a0b49c7d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:37.784889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acba39-5641-4a91-b3c3-154a0b49c7d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:37.845710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acba39-5641-4a91-b3c3-154a0b49c7d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:37.847115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acba39-5641-4a91-b3c3-154a0b49c7d6 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:37.857392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1089/2163] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:38.339584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:38.608668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:38.769012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:38.770474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:38.980814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b3be-377d-47fc-973c-40e51f65c0cf service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:38.993522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:38.994255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:38.994537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:38.994809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] PATH_INFO: `/v3/users/b512f4df76d148369d6af74d0560ca7f` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:38.996016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b512f4df76d148369d6af74d0560ca7f)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:38.997958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:39.308044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b512f4df76d148369d6af74d0560ca7f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:39.322357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b512f4df76d148369d6af74d0560ca7f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:39.330299 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b512f4df76d148369d6af74d0560ca7f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:39.331063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b512f4df76d148369d6af74d0560ca7f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:39.331706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b512f4df76d148369d6af74d0560ca7f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:39.454159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1075/2164] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:38 2022] DELETE /identity/v3/users/b512f4df76d148369d6af74d0560ca7f => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:39.458786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:39.459076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:39.459399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:39.479698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:39.480926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:39.559001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1090/2165] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:39.571464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:39.573965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:39.658238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0b4a-ec4a-40ff-94bd-85b1f93993c3 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:39.662495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:39.663665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:39.663944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:39.664704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:39.676242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:39.678219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:39.690744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1076/2166] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:40.112341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:40.238735 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:40.240378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:40.257935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d347313-d2bb-4041-bc53-a6c27dfad1e9 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:40.264571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:40.268190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:40.268190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:40.268190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] PATH_INFO: `/v3/projects/e0c890b80c764498a53aa7c97e66c84e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:40.268437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c890b80c764498a53aa7c97e66c84e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:40.272968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:40.421366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:40.463194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c890b80c764498a53aa7c97e66c84e', 'request_id': 'req-f55454b0-f0b2-4683-86cf-ce585e682ef0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.470312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c890b80c764498a53aa7c97e66c84e', 'request_id': 'req-f55454b0-f0b2-4683-86cf-ce585e682ef0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.596998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c890b80c764498a53aa7c97e66c84e', 'request_id': 'req-f55454b0-f0b2-4683-86cf-ce585e682ef0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.614318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] The token cache is being invalidate because project e0c890b80c764498a53aa7c97e66c84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:40.614654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.615308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.616860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1091/2167] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:40 2022] DELETE /identity/v3/projects/e0c890b80c764498a53aa7c97e66c84e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:40.621483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:40.634151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec038a-2cce-48db-a55d-14da327fda52 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:40.705433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:40.706293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:40.706574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:40.706849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] PATH_INFO: `/v3/users/f95086ceff6040cdafae5c1f822bb233` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:40.708098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95086ceff6040cdafae5c1f822bb233)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:40.710196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:40.943313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95086ceff6040cdafae5c1f822bb233'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.967570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95086ceff6040cdafae5c1f822bb233'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.968968 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95086ceff6040cdafae5c1f822bb233'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.969746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95086ceff6040cdafae5c1f822bb233'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:40.970375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95086ceff6040cdafae5c1f822bb233'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.061838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1077/2168] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:40 2022] DELETE /identity/v3/users/f95086ceff6040cdafae5c1f822bb233 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:41.398762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:41.400369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:41.427385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55454b0-f0b2-4683-86cf-ce585e682ef0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:41.536366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:41.537947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:41.540766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:41.541436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:41.545774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:41.546292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] PATH_INFO: `/v3/users/c0ea59b1c7434d98898cd5954b3b4175` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:41.548454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ea59b1c7434d98898cd5954b3b4175)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:41.554221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:41.558706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51d36-3324-4577-801a-79b78893d46a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:41.564770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:41.565559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:41.566631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:41.567041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] PATH_INFO: `/v3/projects/5d8c1838ddfe4cb9b85ff23acec0334c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:41.568339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8c1838ddfe4cb9b85ff23acec0334c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:41.571364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:41.736559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:41.768061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8c1838ddfe4cb9b85ff23acec0334c', 'request_id': 'req-4c6e8740-6829-46bd-a5aa-c4d45baef58a'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.771076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ea59b1c7434d98898cd5954b3b4175'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.773139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ea59b1c7434d98898cd5954b3b4175'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.787880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8c1838ddfe4cb9b85ff23acec0334c', 'request_id': 'req-4c6e8740-6829-46bd-a5aa-c4d45baef58a'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.793231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ea59b1c7434d98898cd5954b3b4175'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.888534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8c1838ddfe4cb9b85ff23acec0334c', 'request_id': 'req-4c6e8740-6829-46bd-a5aa-c4d45baef58a'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.910930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] The token cache is being invalidate because project 5d8c1838ddfe4cb9b85ff23acec0334c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:41.918688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.918688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4c6e8740-6829-46bd-a5aa-c4d45baef58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:41.918688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1078/2169] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:41 2022] DELETE /identity/v3/projects/5d8c1838ddfe4cb9b85ff23acec0334c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:41.920599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3281-d634-40e6-b703-8fa8c1c6c64e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:41.920979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3281-d634-40e6-b703-8fa8c1c6c64e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:41.921368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3281-d634-40e6-b703-8fa8c1c6c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:41.958688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-366b3281-d634-40e6-b703-8fa8c1c6c64e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:41.958688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-366b3281-d634-40e6-b703-8fa8c1c6c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:42.001934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ea59b1c7434d98898cd5954b3b4175'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:42.020277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ff9bef7a-a148-4967-93bc-b0ff4329fd26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ea59b1c7434d98898cd5954b3b4175'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:42.028346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1079/2170] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:42.028640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1092/2171] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:41 2022] DELETE /identity/v3/users/c0ea59b1c7434d98898cd5954b3b4175 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:42.033067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5b72-3f6e-418a-9a0b-26ca013923be None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.033353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5b72-3f6e-418a-9a0b-26ca013923be None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.033627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5b72-3f6e-418a-9a0b-26ca013923be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.035880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.036183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.036460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.074402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:42.075767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:42.078214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-360b5b72-3f6e-418a-9a0b-26ca013923be None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:42.080456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-360b5b72-3f6e-418a-9a0b-26ca013923be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:42.157728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1093/2172] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:42.169389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.171763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:42.191638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1080/2173] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:42.192777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5b72-3f6e-418a-9a0b-26ca013923be None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.210359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5b72-3f6e-418a-9a0b-26ca013923be None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.216734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.217539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.217826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.218153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.218818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:42.220282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.223290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.239233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1081/2174] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:48:42.241318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.259121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da8ff-bc5f-4645-860f-85fbf5151c3b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.265928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.267639 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.268151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.268420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.268738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c0c44-17e2-45b1-b097-71fcee5934bc None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.269098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.271059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.272867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.273520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.273748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.274292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.285592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.287048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.297501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1094/2175] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:48:42.418459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1082/2176] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:42 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:42.419706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.435212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b74952-c5cc-422a-a076-09eb40a0aa14 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.563608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.567225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.573014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.575020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.575947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.579287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.684683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1095/2177] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:42 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:42.689856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.701437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1238c0-15ca-4484-995c-2e21daa24fa1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.707531 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.708151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.708425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.708862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.709682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.711719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.729815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1083/2178] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:42.734620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.747760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd88ee-a754-44a9-a9ef-1435ed47203d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.754985 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76aec-1f95-4df3-8610-a15aefbf7ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.755654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76aec-1f95-4df3-8610-a15aefbf7ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.755929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76aec-1f95-4df3-8610-a15aefbf7ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.756243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76aec-1f95-4df3-8610-a15aefbf7ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.756907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76aec-1f95-4df3-8610-a15aefbf7ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.758598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76aec-1f95-4df3-8610-a15aefbf7ffd admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.770831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1096/2179] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:42.775210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:42.779956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:42.794790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfd919-2194-4eef-9ac7-7957d1d8a8a9 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:42.805059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f3ec7-7917-4029-8203-b1277650593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:42.807326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f3ec7-7917-4029-8203-b1277650593e admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.807696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f3ec7-7917-4029-8203-b1277650593e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.812745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f3ec7-7917-4029-8203-b1277650593e admin admin] PATH_INFO: `/v3/projects/e2f62a5fdc244776a6d9ac64959da41b/users/af6c0913ae9640ddac287b00dd7c9594/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.826948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f3ec7-7917-4029-8203-b1277650593e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f62a5fdc244776a6d9ac64959da41b, user_id=af6c0913ae9640ddac287b00dd7c9594, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:42.830010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f3ec7-7917-4029-8203-b1277650593e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:42.895225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1084/2180] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:42 2022] PUT /identity/v3/projects/e2f62a5fdc244776a6d9ac64959da41b/users/af6c0913ae9640ddac287b00dd7c9594/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:42.910055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.910340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.910614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:42.975039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b68fb-6015-417e-b269-cb14bcf93763 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:42.975391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b68fb-6015-417e-b269-cb14bcf93763 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:42.975717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b68fb-6015-417e-b269-cb14bcf93763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.011112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] MFA Rules not processed for user `af6c0913ae9640ddac287b00dd7c9594`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:43.014533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.060207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b66b68fb-6015-417e-b269-cb14bcf93763 None None] MFA Rules not processed for user `a9ec9d7971ad4bd5a176bf95e7a2b135`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:43.061953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b66b68fb-6015-417e-b269-cb14bcf93763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.163008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1097/2181] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:43.165659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:43.165659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.193110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1085/2182] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:43.204597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.204937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.205162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.225711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] MFA Rules not processed for user `a9ec9d7971ad4bd5a176bf95e7a2b135`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:43.226967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.234390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1086/2183] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:43.245610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:43.247067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.247528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361b57a-4efc-4efa-b714-7b75bc8c10eb None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:43.254786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:43.255476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.255749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.256016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] PATH_INFO: `/v3/projects/f67ea65abe494670bb364a482df295d1` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.257387 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67ea65abe494670bb364a482df295d1)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:43.259906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:43.339049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babf0a1-c8d5-4f47-8325-08ebeff68bb1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:43.344986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:43.345608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.345893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.346168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.354652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:43.356298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:43.365220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1087/2184] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:43.365999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:43.367295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.399974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67ea65abe494670bb364a482df295d1', 'request_id': 'req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:43.406970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67ea65abe494670bb364a482df295d1', 'request_id': 'req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:43.435514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28d25-4cf6-4d2a-90f0-0eeda0fc78f2 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:43.488979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1792-03f9-44d4-9f82-3b990398a5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:43.489618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1792-03f9-44d4-9f82-3b990398a5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.489895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1792-03f9-44d4-9f82-3b990398a5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.490212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1792-03f9-44d4-9f82-3b990398a5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.510945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67ea65abe494670bb364a482df295d1', 'request_id': 'req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:43.537118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] The token cache is being invalidate because project f67ea65abe494670bb364a482df295d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:43.537492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:43.552815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ce2900bc-e7fd-4406-9bda-c3e213abd1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:43.554769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1098/2185] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:43 2022] DELETE /identity/v3/projects/f67ea65abe494670bb364a482df295d1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:43.559896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82892-ace9-4c88-8230-a7e1bdc976ff None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.560261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82892-ace9-4c88-8230-a7e1bdc976ff None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.560642 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82892-ace9-4c88-8230-a7e1bdc976ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.609091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-09f82892-ace9-4c88-8230-a7e1bdc976ff None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:43.612114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-09f82892-ace9-4c88-8230-a7e1bdc976ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.621659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1792-03f9-44d4-9f82-3b990398a5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:43.624126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1792-03f9-44d4-9f82-3b990398a5f6 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:43.636898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1088/2186] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:43.659577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:43.784694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1099/2187] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:43.786363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934212f5-7d49-4d2e-bcb3-82eb5d3cbf59 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.786841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934212f5-7d49-4d2e-bcb3-82eb5d3cbf59 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.786956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934212f5-7d49-4d2e-bcb3-82eb5d3cbf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.822053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-934212f5-7d49-4d2e-bcb3-82eb5d3cbf59 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:43.823361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-934212f5-7d49-4d2e-bcb3-82eb5d3cbf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:43.839331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1089/2188] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:43.841264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f82892-ace9-4c88-8230-a7e1bdc976ff None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:43.859368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f82892-ace9-4c88-8230-a7e1bdc976ff None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:43.866565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:43.867338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.867693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.868033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.869080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:43.869415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:43.871518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:43.890817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1100/2189] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:43.892186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934212f5-7d49-4d2e-bcb3-82eb5d3cbf59 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:43.903010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934212f5-7d49-4d2e-bcb3-82eb5d3cbf59 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:43.920700 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:43.921326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:43.928896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:43.928896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:43.928896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:43.928896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:44.032350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1090/2190] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:43 2022] POST /identity/v3/projects => generated 399 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:44.036095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:44.046775 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034cbc-7fec-457e-9317-9af99a269ef1 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:44.116824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:44.117430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:44.117708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:44.118286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:44.118798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:44.120921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:44.243417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1101/2191] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:44 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:44.247276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:44.258109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a9e48-d731-4463-84ca-3e9d9b22d91b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:44.262966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:44.263598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:44.263874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:44.264154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:44.264799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:44.266940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:44.276997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1091/2192] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:44.281210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:44.295721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ff71-9e52-4e7d-ab48-2921305de853 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:44.302215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfb4a1-873f-4fa0-910b-2cf1c9b4efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:44.305734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb4a1-873f-4fa0-910b-2cf1c9b4efdc admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:44.305734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb4a1-873f-4fa0-910b-2cf1c9b4efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:44.305734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb4a1-873f-4fa0-910b-2cf1c9b4efdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:44.305734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfb4a1-873f-4fa0-910b-2cf1c9b4efdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:44.306043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfb4a1-873f-4fa0-910b-2cf1c9b4efdc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:44.323407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:44.335369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b07e4-5981-4df1-98c9-d349461854a4 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:44.335566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1102/2193] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:44.341256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02daba8-dfb3-4e04-a4ea-066ec68928be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:44.342321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02daba8-dfb3-4e04-a4ea-066ec68928be admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:44.342599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02daba8-dfb3-4e04-a4ea-066ec68928be admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:44.343129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02daba8-dfb3-4e04-a4ea-066ec68928be admin admin] PATH_INFO: `/v3/projects/cfa774624bb348bc9de152fb8f2af4e0/users/43064cf287624b77adfb6f5bc0c672e2/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:44.397486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02daba8-dfb3-4e04-a4ea-066ec68928be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa774624bb348bc9de152fb8f2af4e0, user_id=43064cf287624b77adfb6f5bc0c672e2, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:44.401333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02daba8-dfb3-4e04-a4ea-066ec68928be admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:44.484624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1092/2194] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:44 2022] PUT /identity/v3/projects/cfa774624bb348bc9de152fb8f2af4e0/users/43064cf287624b77adfb6f5bc0c672e2/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:44.488182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:44.488461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:44.492424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:44.512421 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:44.512797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:44.513135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:44.563975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:44.576690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] MFA Rules not processed for user `a9ec9d7971ad4bd5a176bf95e7a2b135`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:44.581662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:44.582267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] MFA Rules not processed for user `43064cf287624b77adfb6f5bc0c672e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:44.584566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:44.688146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1093/2195] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:44.695982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1103/2196] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:44.755418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:44.756832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:44.836566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb42337-d31b-4778-8b23-3bbe0e151ed0 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:44.842962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17392-ca0c-4956-978f-2895e985d8dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:44.843618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17392-ca0c-4956-978f-2895e985d8dc service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:44.843900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17392-ca0c-4956-978f-2895e985d8dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:44.844295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17392-ca0c-4956-978f-2895e985d8dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:44.856921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17392-ca0c-4956-978f-2895e985d8dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:44.858807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17392-ca0c-4956-978f-2895e985d8dc service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:44.878114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1094/2197] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:45.539532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:47.145311 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:47.395547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:47.396978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:47.484562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dde1a-fd94-4810-999b-60ea282d6403 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:47.492705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:47.493361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:47.493664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:47.493966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] PATH_INFO: `/v3/users/9ee37f36b7964349b55be016de52f18b` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:47.495108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee37f36b7964349b55be016de52f18b)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:47.497175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:47.513441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:47.911929 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee37f36b7964349b55be016de52f18b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:47.912690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee37f36b7964349b55be016de52f18b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:47.926942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee37f36b7964349b55be016de52f18b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:48.053438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee37f36b7964349b55be016de52f18b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:48.067732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee37f36b7964349b55be016de52f18b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:48.083086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1104/2198] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:47 2022] DELETE /identity/v3/users/9ee37f36b7964349b55be016de52f18b => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:48.084941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:48.088611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:48.088611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:48.106105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:48.107561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:48.175471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1095/2199] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:48.185898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:48.187711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:48.250369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0832b-e376-4252-9409-afce0124431c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:48.255545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:48.256428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:48.256728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:48.257000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:48.267631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:48.268964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:48.278615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1105/2200] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:48.739338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:48.889352 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:48.890980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:48.904949 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ada00-4dc1-4dfc-b8df-a819049c9f52 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:48.910972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:48.912567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:48.913049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:48.913539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] PATH_INFO: `/v3/projects/cb97500f04384007b672db3ec587698b` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:48.915904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb97500f04384007b672db3ec587698b)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:48.918135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:49.140794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb97500f04384007b672db3ec587698b', 'request_id': 'req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.149781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb97500f04384007b672db3ec587698b', 'request_id': 'req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.237216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb97500f04384007b672db3ec587698b', 'request_id': 'req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.240856 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:49.250724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] The token cache is being invalidate because project cb97500f04384007b672db3ec587698b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:49.251295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.251994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.253916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1096/2201] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:48 2022] DELETE /identity/v3/projects/cb97500f04384007b672db3ec587698b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:49.262345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:49.273224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c69c6-fcd5-4cf7-883e-4825626a943e service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:49.342278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:49.345301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:49.345787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:49.346305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] PATH_INFO: `/v3/users/0ba2d8ea2f9846ce9469442e546e44b1` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:49.348095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba2d8ea2f9846ce9469442e546e44b1)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:49.350481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:49.589563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba2d8ea2f9846ce9469442e546e44b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.590228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba2d8ea2f9846ce9469442e546e44b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.598406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba2d8ea2f9846ce9469442e546e44b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.739463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba2d8ea2f9846ce9469442e546e44b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.756677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-46880fc4-b431-4a61-9051-5ef13a251378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba2d8ea2f9846ce9469442e546e44b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:49.764339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1106/2202] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:49 2022] DELETE /identity/v3/users/0ba2d8ea2f9846ce9469442e546e44b1 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:50.287186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:50.289134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:50.304260 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a4b2d-b8dc-4d3f-9b2a-7b358ede7a5e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:50.368796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:50.369436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:50.369717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:50.369989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] PATH_INFO: `/v3/projects/0c49723a228f43a98d865f0432fc5c56` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:50.371231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c49723a228f43a98d865f0432fc5c56)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:50.377874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:50.551519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:50.557490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c49723a228f43a98d865f0432fc5c56', 'request_id': 'req-eae7ae29-1545-49e9-b725-dfa860406e4b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:50.572950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c49723a228f43a98d865f0432fc5c56', 'request_id': 'req-eae7ae29-1545-49e9-b725-dfa860406e4b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:50.664834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c49723a228f43a98d865f0432fc5c56', 'request_id': 'req-eae7ae29-1545-49e9-b725-dfa860406e4b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:50.680550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] The token cache is being invalidate because project 0c49723a228f43a98d865f0432fc5c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:50.680980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:50.682045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eae7ae29-1545-49e9-b725-dfa860406e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:50.684094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1097/2203] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:50 2022] DELETE /identity/v3/projects/0c49723a228f43a98d865f0432fc5c56 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:50.689324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fc4a-2f57-448a-b2f4-17755a5ebaac None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:50.689611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fc4a-2f57-448a-b2f4-17755a5ebaac None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:50.689891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fc4a-2f57-448a-b2f4-17755a5ebaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:50.717473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5fb0fc4a-2f57-448a-b2f4-17755a5ebaac None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:50.718658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5fb0fc4a-2f57-448a-b2f4-17755a5ebaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:50.821540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1107/2204] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:50.832799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a033d2c-80e1-4ab7-8fb9-ba1fa0fb1617 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:50.833974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a033d2c-80e1-4ab7-8fb9-ba1fa0fb1617 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:50.834974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a033d2c-80e1-4ab7-8fb9-ba1fa0fb1617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:50.858125 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6a033d2c-80e1-4ab7-8fb9-ba1fa0fb1617 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:50.861429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6a033d2c-80e1-4ab7-8fb9-ba1fa0fb1617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:50.878149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1098/2205] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:50.883183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0fc4a-2f57-448a-b2f4-17755a5ebaac None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:50.896780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0fc4a-2f57-448a-b2f4-17755a5ebaac None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:50.901772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:50.902602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:50.903029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:50.910196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:50.910196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:50.910196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:50.910196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:50.919758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1108/2206] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:48:50.926518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a033d2c-80e1-4ab7-8fb9-ba1fa0fb1617 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:50.932589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:50.939755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a033d2c-80e1-4ab7-8fb9-ba1fa0fb1617 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:50.947526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:50.948177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:50.948454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:50.948921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:50.949616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:50.951781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:51.127899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1099/2207] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:50 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:51.132590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:51.142897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359188ce-eaa7-469f-88a6-6486584b1044 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:51.216016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:51.216651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:51.219003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:51.219003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:51.219003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:51.220311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:51.341056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1109/2208] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:51 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:51.345995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:51.357343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75318e-43f9-4dd0-a5ee-7c7153d05a86 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:51.368049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:51.373642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:51.373642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:51.373642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:51.373642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:51.373642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:51.384836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1100/2209] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:51.388607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:51.401090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9402-3d1a-4715-a208-c3126f677fc8 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:51.413646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52450672-5c29-402f-8be8-390d002a1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:51.413646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450672-5c29-402f-8be8-390d002a1081 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:51.413646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450672-5c29-402f-8be8-390d002a1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:51.413646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450672-5c29-402f-8be8-390d002a1081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:51.414065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52450672-5c29-402f-8be8-390d002a1081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:51.416096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52450672-5c29-402f-8be8-390d002a1081 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:51.434204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1110/2210] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:51.438595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:51.454231 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b1973-8155-49fc-a454-95104ad4e98b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:51.458991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:51.459669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:51.471199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:51.471199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] PATH_INFO: `/v3/projects/05364811d6384abf869898e61f91b517/users/5f99b3ba1d104586b42e168f9975bc2c/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:51.481380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05364811d6384abf869898e61f91b517, user_id=5f99b3ba1d104586b42e168f9975bc2c, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:51.484306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:51.576411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1101/2211] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:51 2022] PUT /identity/v3/projects/05364811d6384abf869898e61f91b517/users/5f99b3ba1d104586b42e168f9975bc2c/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:51.587218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:51.587564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:51.587900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:51.616895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] MFA Rules not processed for user `5f99b3ba1d104586b42e168f9975bc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:51.618260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:51.699634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1111/2212] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:51.711210 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:51.712933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:51.769935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6908-07a7-4d0e-aa21-02f1b5fab646 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:51.774140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3bba7-90f2-4177-94c6-573ab29c81d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:51.774768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3bba7-90f2-4177-94c6-573ab29c81d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:51.775050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3bba7-90f2-4177-94c6-573ab29c81d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:51.775356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3bba7-90f2-4177-94c6-573ab29c81d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:51.785732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3bba7-90f2-4177-94c6-573ab29c81d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:51.787225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3bba7-90f2-4177-94c6-573ab29c81d6 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:51.796667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1102/2213] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:51.922593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:52.070781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:52.554957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:52.556447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:52.621919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232264aa-303e-4f93-b68a-0a41dd97c653 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:52.627242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:52.627930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:52.628209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:52.628479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] PATH_INFO: `/v3/users/af6c0913ae9640ddac287b00dd7c9594` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:52.629905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6c0913ae9640ddac287b00dd7c9594)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:52.631867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:52.890475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6c0913ae9640ddac287b00dd7c9594'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:52.891778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6c0913ae9640ddac287b00dd7c9594'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:52.898523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6c0913ae9640ddac287b00dd7c9594'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:52.985453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:52.985930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6c0913ae9640ddac287b00dd7c9594'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:52.999061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6c0913ae9640ddac287b00dd7c9594'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:53.006146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1112/2214] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:52 2022] DELETE /identity/v3/users/af6c0913ae9640ddac287b00dd7c9594 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:53.011133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:53.011448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:53.011725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:53.031096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:53.032360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:53.103879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1103/2215] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:53.110515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:53.112014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:53.176928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe446c-d5ab-457c-a84e-558ea8c7991d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:53.180701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c046ace-da7b-4db3-8237-0d56da2414e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:53.181324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c046ace-da7b-4db3-8237-0d56da2414e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:53.181612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c046ace-da7b-4db3-8237-0d56da2414e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:53.181880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c046ace-da7b-4db3-8237-0d56da2414e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:53.191260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c046ace-da7b-4db3-8237-0d56da2414e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:53.192679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c046ace-da7b-4db3-8237-0d56da2414e7 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:53.202017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1113/2216] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:53.957164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:54.040154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.041801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:54.071310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e67bf3-507b-40e8-abe0-a8538ecb7ae6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.076546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.077319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.077659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.077998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] PATH_INFO: `/v3/projects/e2f62a5fdc244776a6d9ac64959da41b` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.079307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f62a5fdc244776a6d9ac64959da41b)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.081347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.225453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f62a5fdc244776a6d9ac64959da41b', 'request_id': 'req-3204c5f3-bd24-4725-8141-75adb1a85e8e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.231600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f62a5fdc244776a6d9ac64959da41b', 'request_id': 'req-3204c5f3-bd24-4725-8141-75adb1a85e8e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.310523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f62a5fdc244776a6d9ac64959da41b', 'request_id': 'req-3204c5f3-bd24-4725-8141-75adb1a85e8e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.321805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] The token cache is being invalidate because project e2f62a5fdc244776a6d9ac64959da41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:54.322070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.322743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3204c5f3-bd24-4725-8141-75adb1a85e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.324484 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1104/2217] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:54 2022] DELETE /identity/v3/projects/e2f62a5fdc244776a6d9ac64959da41b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:54.329964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725ecd-9d6c-4ad2-8c5e-7e3795920b5a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.330413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725ecd-9d6c-4ad2-8c5e-7e3795920b5a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.330519 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725ecd-9d6c-4ad2-8c5e-7e3795920b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.351425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-10725ecd-9d6c-4ad2-8c5e-7e3795920b5a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:54.352636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-10725ecd-9d6c-4ad2-8c5e-7e3795920b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:54.410664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1114/2218] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:54.419680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d1cd-b2dd-449b-a992-6aca98ac6b8f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.425610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d1cd-b2dd-449b-a992-6aca98ac6b8f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.425610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d1cd-b2dd-449b-a992-6aca98ac6b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.440266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4a04d1cd-b2dd-449b-a992-6aca98ac6b8f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:54.441483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4a04d1cd-b2dd-449b-a992-6aca98ac6b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:54.449394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1105/2219] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:54.454288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725ecd-9d6c-4ad2-8c5e-7e3795920b5a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.464046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725ecd-9d6c-4ad2-8c5e-7e3795920b5a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.468684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.469294 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.469565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.469829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.470488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:54.470784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.472457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.483909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1115/2220] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:54.488472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d1cd-b2dd-449b-a992-6aca98ac6b8f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.497892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d1cd-b2dd-449b-a992-6aca98ac6b8f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.503320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.504193 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.504471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.504738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.505366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.507452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.589551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.591271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:54.603900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66391153-a84f-4f92-bd20-4ed4325e81a1 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.608450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.609067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.609344 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.609617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] PATH_INFO: `/v3/users/43064cf287624b77adfb6f5bc0c672e2` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.610748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43064cf287624b77adfb6f5bc0c672e2)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.612725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.613518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:54.654011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1106/2221] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:54 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:54.655079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.717360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88419142-076f-4a2d-89a2-1e3a42bbbebc admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.722228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.722925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.723234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.723529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.724199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.726152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.808490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1107/2222] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:54 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:54.812633 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.823478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71a04c-a433-4f63-b139-89d40b7af3c4 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.825741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43064cf287624b77adfb6f5bc0c672e2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.826471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43064cf287624b77adfb6f5bc0c672e2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.828256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.830567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.830567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.830567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.830567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.832467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.834392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43064cf287624b77adfb6f5bc0c672e2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.843239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1108/2223] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:54.849968 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.860850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018f9c8-f822-41d8-951b-7e78bac92449 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.865665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.866257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.866542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.866808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.867592 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.869415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.881175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1109/2224] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:54.885116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:54.895185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad58a1c-d748-48f6-937c-60bd789c089d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:54.899936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759dfcb-093a-4482-b90a-d31b69896c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:54.900603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dfcb-093a-4482-b90a-d31b69896c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.900863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dfcb-093a-4482-b90a-d31b69896c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.901136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dfcb-093a-4482-b90a-d31b69896c7d admin admin] PATH_INFO: `/v3/projects/ea7818e397cd43e3a6510e9f5f66aa85/users/c677776ba4e448f297e590f55f03cea0/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.916912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dfcb-093a-4482-b90a-d31b69896c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7818e397cd43e3a6510e9f5f66aa85, user_id=c677776ba4e448f297e590f55f03cea0, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:54.919634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dfcb-093a-4482-b90a-d31b69896c7d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:54.950682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43064cf287624b77adfb6f5bc0c672e2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.963466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d4495bd5-acbb-49ae-afc4-79004cca5be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43064cf287624b77adfb6f5bc0c672e2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:54.969477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1116/2225] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:54 2022] DELETE /identity/v3/users/43064cf287624b77adfb6f5bc0c672e2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:54.973634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:54.973912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:54.974184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:54.994176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:54.995461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:55.013888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1110/2226] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:54 2022] PUT /identity/v3/projects/ea7818e397cd43e3a6510e9f5f66aa85/users/c677776ba4e448f297e590f55f03cea0/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:48:55.024339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:55.024732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:55.025109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:55.055321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] MFA Rules not processed for user `c677776ba4e448f297e590f55f03cea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:55.056533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:55.058945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1117/2227] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:55.069937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:55.072857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:55.122050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:55.158582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2fd8a-a238-4838-ab86-fb401e8b13d0 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:55.192088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1111/2228] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:55.205851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:55.209115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:55.238708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:55.238708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:55.238708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:55.239407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:55.271380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:55.310523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:55.312224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:55.323517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1118/2229] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:55.333498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c699f-a4b2-4115-9ee1-919b9fb5e77e None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:55.337253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054c6a8-63c4-4d8d-917f-d6ba7ae133bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:55.338104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c6a8-63c4-4d8d-917f-d6ba7ae133bf service glance] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:55.338549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c6a8-63c4-4d8d-917f-d6ba7ae133bf service glance] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:55.338909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c6a8-63c4-4d8d-917f-d6ba7ae133bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:55.348803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054c6a8-63c4-4d8d-917f-d6ba7ae133bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:55.350299 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054c6a8-63c4-4d8d-917f-d6ba7ae133bf service glance] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:55.362224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1112/2230] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:48:55.409609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:55.580037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:56.144034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:56.146059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:56.160822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e44cb-c448-439a-a838-d308791ee94b service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:56.168373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:56.169370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:56.169649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:56.169911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] PATH_INFO: `/v3/projects/cfa774624bb348bc9de152fb8f2af4e0` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:56.171362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa774624bb348bc9de152fb8f2af4e0)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:56.174027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:56.325877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa774624bb348bc9de152fb8f2af4e0', 'request_id': 'req-b4f252da-87d5-4507-8515-db75171bfe4f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:56.331928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa774624bb348bc9de152fb8f2af4e0', 'request_id': 'req-b4f252da-87d5-4507-8515-db75171bfe4f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:56.401627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa774624bb348bc9de152fb8f2af4e0', 'request_id': 'req-b4f252da-87d5-4507-8515-db75171bfe4f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:56.418078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] The token cache is being invalidate because project cfa774624bb348bc9de152fb8f2af4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:56.419127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:56.420121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b4f252da-87d5-4507-8515-db75171bfe4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:56.424526 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1119/2231] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:56 2022] DELETE /identity/v3/projects/cfa774624bb348bc9de152fb8f2af4e0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:56.871089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:56.911199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:57.100200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150d24e-b088-4045-a338-c1ced68aa756 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:57.100495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150d24e-b088-4045-a338-c1ced68aa756 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:57.100770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150d24e-b088-4045-a338-c1ced68aa756 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:57.102230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1113/2232] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:48:57.113730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ace4c-b61a-432f-a111-ed06e50a2bf4 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:57.114014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ace4c-b61a-432f-a111-ed06e50a2bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:57.114296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ace4c-b61a-432f-a111-ed06e50a2bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:57.140722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-2f2ace4c-b61a-432f-a111-ed06e50a2bf4 None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:57.142644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2f2ace4c-b61a-432f-a111-ed06e50a2bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:57.206415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1120/2233] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:57.217419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93badac-0a3b-48ae-b914-c1d2d06a9bc8 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:57.217701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93badac-0a3b-48ae-b914-c1d2d06a9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:57.217973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93badac-0a3b-48ae-b914-c1d2d06a9bc8 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:57.220057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1114/2234] 10.222.0.69 () {54 vars in 961 bytes} [Thu Sep 1 16:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:48:57.225525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c91e-5a36-4316-b522-d2140b980f3c None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:57.225897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c91e-5a36-4316-b522-d2140b980f3c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:57.226174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c91e-5a36-4316-b522-d2140b980f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:57.240577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93badac-0a3b-48ae-b914-c1d2d06a9bc8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:57.242353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b93badac-0a3b-48ae-b914-c1d2d06a9bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:57.252208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-48b3c91e-5a36-4316-b522-d2140b980f3c None None] MFA Rules not processed for user `f9bc79bd5c8149679d8d7f85095e5be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:57.253551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-48b3c91e-5a36-4316-b522-d2140b980f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:57.265823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1121/2235] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Sep 1 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:57.275546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3c91e-5a36-4316-b522-d2140b980f3c None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:57.291105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3c91e-5a36-4316-b522-d2140b980f3c None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:57.297962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:57.298848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:57.299189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:57.299555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:57.311512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:57.312817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:57.337524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1122/2236] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:48:57.351782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93badac-0a3b-48ae-b914-c1d2d06a9bc8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:57.363596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:57.363596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:57.363596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:57.363596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] PATH_INFO: `/v3/users/169d4d93a4c04eb5807323ad5eeb0c7e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:57.364035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=169d4d93a4c04eb5807323ad5eeb0c7e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:57.365117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:57.565346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169d4d93a4c04eb5807323ad5eeb0c7e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:57.578110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169d4d93a4c04eb5807323ad5eeb0c7e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:57.586252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169d4d93a4c04eb5807323ad5eeb0c7e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:57.587007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169d4d93a4c04eb5807323ad5eeb0c7e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:57.589699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169d4d93a4c04eb5807323ad5eeb0c7e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:57.661155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1115/2237] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:57 2022] DELETE /identity/v3/users/169d4d93a4c04eb5807323ad5eeb0c7e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:58.031287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:58.038608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d120e4-8eb2-4953-b20b-3f05f43caed1 service placement] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:58.103770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:58.104421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:58.104691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:58.104956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] PATH_INFO: `/v3/projects/932d00cd4d6a4c8e8367fd1ef60ba9cb` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:58.106208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] RBAC: Authorizing `identity:delete_project(project_id=932d00cd4d6a4c8e8367fd1ef60ba9cb)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:58.111196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:58.207646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932d00cd4d6a4c8e8367fd1ef60ba9cb', 'request_id': 'req-6cc568ae-087e-43e3-8b9b-809621e3565d'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.212927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932d00cd4d6a4c8e8367fd1ef60ba9cb', 'request_id': 'req-6cc568ae-087e-43e3-8b9b-809621e3565d'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.300244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932d00cd4d6a4c8e8367fd1ef60ba9cb', 'request_id': 'req-6cc568ae-087e-43e3-8b9b-809621e3565d'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.313690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] The token cache is being invalidate because project 932d00cd4d6a4c8e8367fd1ef60ba9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:58.314359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.314836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.316532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1123/2238] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:58 2022] DELETE /identity/v3/projects/932d00cd4d6a4c8e8367fd1ef60ba9cb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:58.320620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:58.322164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:58.339470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc0bf-2634-438d-af1b-40e5d2b2cb6b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:58.353933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:58.416866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:58.417501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:58.417975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:58.418164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] PATH_INFO: `/v3/users/f1094cb45bb14f48883b335ea232a8f7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:58.419457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1094cb45bb14f48883b335ea232a8f7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:58.421276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:58.598796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1094cb45bb14f48883b335ea232a8f7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.616163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1094cb45bb14f48883b335ea232a8f7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.623449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1094cb45bb14f48883b335ea232a8f7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.624175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1094cb45bb14f48883b335ea232a8f7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.624801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c45cd86c-497e-4f56-bec0-742763e53456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1094cb45bb14f48883b335ea232a8f7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:58.671342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:58.698839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1116/2239] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:48:58 2022] DELETE /identity/v3/users/f1094cb45bb14f48883b335ea232a8f7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:59.106471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:59.108055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:59.122085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc568ae-087e-43e3-8b9b-809621e3565d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:59.189688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:59.190240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.190521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.190792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] PATH_INFO: `/v3/projects/f5d43d98c94846de8ec1356b3b1543cd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.192017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d43d98c94846de8ec1356b3b1543cd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:59.194127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:59.288458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d43d98c94846de8ec1356b3b1543cd', 'request_id': 'req-490f447d-67c9-48d2-b16a-3709f733483c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:59.294013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d43d98c94846de8ec1356b3b1543cd', 'request_id': 'req-490f447d-67c9-48d2-b16a-3709f733483c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:59.362140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d43d98c94846de8ec1356b3b1543cd', 'request_id': 'req-490f447d-67c9-48d2-b16a-3709f733483c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:59.376234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] The token cache is being invalidate because project f5d43d98c94846de8ec1356b3b1543cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:48:59.376234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:59.377083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-490f447d-67c9-48d2-b16a-3709f733483c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:48:59.385698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1124/2240] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:48:59 2022] DELETE /identity/v3/projects/f5d43d98c94846de8ec1356b3b1543cd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:48:59.385925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe936-6400-4d0e-8a13-c0963baff095 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.385925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe936-6400-4d0e-8a13-c0963baff095 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.385925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe936-6400-4d0e-8a13-c0963baff095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.413743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2f3fe936-6400-4d0e-8a13-c0963baff095 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:59.414055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2f3fe936-6400-4d0e-8a13-c0963baff095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:59.483033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1117/2241] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:48:59.490651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ada7-2c13-4e53-8bba-0da673b1b78d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.490924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ada7-2c13-4e53-8bba-0da673b1b78d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.491272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ada7-2c13-4e53-8bba-0da673b1b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.520706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:59.526783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6f37ada7-2c13-4e53-8bba-0da673b1b78d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:48:59.528211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6f37ada7-2c13-4e53-8bba-0da673b1b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:59.537220 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1125/2242] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:48:59.542773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe936-6400-4d0e-8a13-c0963baff095 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:59.551068 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe936-6400-4d0e-8a13-c0963baff095 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:59.555642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:59.556294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.556591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.556883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.557519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:48:59.557817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:59.559505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:59.571949 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1118/2243] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:48:59.576261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ada7-2c13-4e53-8bba-0da673b1b78d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:59.585980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ada7-2c13-4e53-8bba-0da673b1b78d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:59.590846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:59.591471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.592517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.592517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.592705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:59.595307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:59.728772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1126/2244] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:48:59 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:48:59.730222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:59.741199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d92cbe-8d27-4874-b575-3ef885ea7bd7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:59.748964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:59.804800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:59.805412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.805736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.806026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.806663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:59.808656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:59.918927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1119/2245] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:48:59 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:48:59.921606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:59.935693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576276e-1c94-4c25-85ce-34936a7cbcf0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:59.941149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:59.941751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.942032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.942309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.942955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:59.944575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:59.957608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1127/2246] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:48:59.960409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:59.970624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d538a-9329-4599-9c4b-285bd79b37aa admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:59.975392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f3a14-afc0-4a91-a6d4-4016b0fdc46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:59.975984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3a14-afc0-4a91-a6d4-4016b0fdc46b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:59.976265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3a14-afc0-4a91-a6d4-4016b0fdc46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:59.976539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f3a14-afc0-4a91-a6d4-4016b0fdc46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:59.977181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f3a14-afc0-4a91-a6d4-4016b0fdc46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:59.978831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f3a14-afc0-4a91-a6d4-4016b0fdc46b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:59.989979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1120/2247] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:48:59.995843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:00.006511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ee233-2118-47c4-992c-39a45ac0549d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:00.011205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:00.011846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:00.012125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:00.012403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] PATH_INFO: `/v3/projects/e0913c4dc6af4028ae943f3740ca40aa/users/85ddac1f84c64b3d879878941762ba6b/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:00.027038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0913c4dc6af4028ae943f3740ca40aa, user_id=85ddac1f84c64b3d879878941762ba6b, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:00.029731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:00.053799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:00.192143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1128/2248] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:48:59 2022] PUT /identity/v3/projects/e0913c4dc6af4028ae943f3740ca40aa/users/85ddac1f84c64b3d879878941762ba6b/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:00.203309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93e95-c1a3-4db0-a054-b9da8752927c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:00.203597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93e95-c1a3-4db0-a054-b9da8752927c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:00.203871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93e95-c1a3-4db0-a054-b9da8752927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:00.231972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-14d93e95-c1a3-4db0-a054-b9da8752927c None None] MFA Rules not processed for user `85ddac1f84c64b3d879878941762ba6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:00.233157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-14d93e95-c1a3-4db0-a054-b9da8752927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:00.299137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1121/2249] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:00.309844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:00.312463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:00.362866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:00.373535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242248ec-17cc-4fa1-8672-a12248ef9323 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:00.377288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb90dd-3da8-4206-ad92-0bba97e1f291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:00.380861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb90dd-3da8-4206-ad92-0bba97e1f291 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:00.380861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb90dd-3da8-4206-ad92-0bba97e1f291 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:00.380861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb90dd-3da8-4206-ad92-0bba97e1f291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:00.387968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb90dd-3da8-4206-ad92-0bba97e1f291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:00.389607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb90dd-3da8-4206-ad92-0bba97e1f291 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:00.398670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1129/2250] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:00.420656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d93e95-c1a3-4db0-a054-b9da8752927c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:00.448657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:00.504751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d93e95-c1a3-4db0-a054-b9da8752927c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:00.509503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:00.510137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:00.510418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:00.510693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] PATH_INFO: `/v3/users/85ddac1f84c64b3d879878941762ba6b` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:00.511931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ddac1f84c64b3d879878941762ba6b)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:00.513893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:00.730815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ddac1f84c64b3d879878941762ba6b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:00.743278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ddac1f84c64b3d879878941762ba6b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:00.750201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ddac1f84c64b3d879878941762ba6b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:00.750882 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ddac1f84c64b3d879878941762ba6b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:00.753248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ddac1f84c64b3d879878941762ba6b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:00.865879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1122/2251] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:00 2022] DELETE /identity/v3/users/85ddac1f84c64b3d879878941762ba6b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:00.871394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a140832-7e19-4195-8095-50741b587c30 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:00.871394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a140832-7e19-4195-8095-50741b587c30 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:00.871394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a140832-7e19-4195-8095-50741b587c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:00.893383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4a140832-7e19-4195-8095-50741b587c30 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:00.894624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4a140832-7e19-4195-8095-50741b587c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:00.980834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1130/2252] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:00.991762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:00.993395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:01.066148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c1ea9-b31e-40fc-a542-6c47ab9185b6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:01.067681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:01.068300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.068579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.068852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.079303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:01.080771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:01.092500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1123/2253] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:49:01.105300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:01.183679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a140832-7e19-4195-8095-50741b587c30 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:01.185511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4a140832-7e19-4195-8095-50741b587c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:01.198518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a140832-7e19-4195-8095-50741b587c30 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:01.203472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:01.204711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.204987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.220969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] PATH_INFO: `/v3/users/9a6971ea37b943708a1f9dc3509fc7b1` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.220969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6971ea37b943708a1f9dc3509fc7b1)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:01.220969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:01.242493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:01.392402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6971ea37b943708a1f9dc3509fc7b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.393150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6971ea37b943708a1f9dc3509fc7b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.401841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6971ea37b943708a1f9dc3509fc7b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.460475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:01.482151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6971ea37b943708a1f9dc3509fc7b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.490564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:01.492675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:01.498999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f8b41415-ff5e-4ad9-ac2b-2e76db662091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6971ea37b943708a1f9dc3509fc7b1'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.507938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1131/2254] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:01 2022] DELETE /identity/v3/users/9a6971ea37b943708a1f9dc3509fc7b1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:01.512747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5a07-ac01-4ff6-8ffd-d77d082c3f67 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:01.515892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.516382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.516949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.541872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:01.543098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:01.562972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:01.575358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:01.575358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.575358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.575358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] PATH_INFO: `/v3/projects/e0913c4dc6af4028ae943f3740ca40aa` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.576579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0913c4dc6af4028ae943f3740ca40aa)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:01.578769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:01.611428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1132/2255] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:01.626754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:01.628306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:01.686378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f9a28-5272-43ce-af43-abd6baa5fd2e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:01.694524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0913c4dc6af4028ae943f3740ca40aa', 'request_id': 'req-4acff0f8-d14f-4186-852d-31559d365fa8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.701557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0913c4dc6af4028ae943f3740ca40aa', 'request_id': 'req-4acff0f8-d14f-4186-852d-31559d365fa8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.738126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910cbc5-327e-4096-96bb-e158ad9be9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:01.738732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cbc5-327e-4096-96bb-e158ad9be9fe service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.739011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cbc5-327e-4096-96bb-e158ad9be9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.739311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cbc5-327e-4096-96bb-e158ad9be9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.775197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0913c4dc6af4028ae943f3740ca40aa', 'request_id': 'req-4acff0f8-d14f-4186-852d-31559d365fa8'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.786868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] The token cache is being invalidate because project e0913c4dc6af4028ae943f3740ca40aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:01.787184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.787998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4acff0f8-d14f-4186-852d-31559d365fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:01.789504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1124/2256] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:01 2022] DELETE /identity/v3/projects/e0913c4dc6af4028ae943f3740ca40aa => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:01.794204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683d858-907b-4543-9999-480a24244ed5 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.794487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683d858-907b-4543-9999-480a24244ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.794759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683d858-907b-4543-9999-480a24244ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.798907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910cbc5-327e-4096-96bb-e158ad9be9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:01.800510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910cbc5-327e-4096-96bb-e158ad9be9fe service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:01.810100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1133/2257] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:01.815048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b683d858-907b-4543-9999-480a24244ed5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:01.819141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b683d858-907b-4543-9999-480a24244ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:01.824776 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1125/2258] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:01.832877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99548-5079-4c57-85e8-4ae3b992ceea None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.833358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99548-5079-4c57-85e8-4ae3b992ceea None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.833707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a99548-5079-4c57-85e8-4ae3b992ceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.855289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a5a99548-5079-4c57-85e8-4ae3b992ceea None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:01.856506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a5a99548-5079-4c57-85e8-4ae3b992ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:01.864602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1134/2259] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:01.869647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683d858-907b-4543-9999-480a24244ed5 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:01.881600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683d858-907b-4543-9999-480a24244ed5 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:01.886323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:01.886928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.887241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.887514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.888167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:01.888471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:01.890077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:01.902379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1126/2260] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:49:01.906724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99548-5079-4c57-85e8-4ae3b992ceea None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:01.915965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a99548-5079-4c57-85e8-4ae3b992ceea None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:01.920755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:01.921426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:01.921708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:01.921977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:01.922630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:01.924581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.065056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1135/2261] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:01 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:02.069214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.081315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15b9d-d8df-412b-aaae-f2d561e8f43b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.084488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:02.163599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:02.177876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.178553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.178845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.179146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.182261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.182261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.282979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1127/2262] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:02 2022] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:02.287424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.298928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d2ba8-5843-4ba1-ab75-a2daf35924c3 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.303829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.304486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.305292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.306614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:02.307074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.307858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.309505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.321606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1136/2263] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:02.328043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.338182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c45607-6ed0-400e-8986-d533a2447dd1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.342653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.343367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.343646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.343917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.344614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.346322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.357124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.357124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.358039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1128/2264] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:02.363585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.374333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f860-860c-488e-a129-cc359cfcfa4e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.375341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f325ea-036e-465c-8d12-0672ec4f411b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.380795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.381529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.383145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.385531 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] PATH_INFO: `/v3/projects/cd746256b1d7472f81df994328df2ed2` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.385959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8df31-82d6-44e1-af6c-f5aa0f0f77bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.385959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8df31-82d6-44e1-af6c-f5aa0f0f77bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.385959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8df31-82d6-44e1-af6c-f5aa0f0f77bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.385959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8df31-82d6-44e1-af6c-f5aa0f0f77bf admin admin] PATH_INFO: `/v3/projects/917950a31f9b485bb347864e700c78d6/users/894eaeeacf0f4d7c81d4df7c3c9e8a80/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.388124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd746256b1d7472f81df994328df2ed2)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.390100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.405907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8df31-82d6-44e1-af6c-f5aa0f0f77bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=917950a31f9b485bb347864e700c78d6, user_id=894eaeeacf0f4d7c81d4df7c3c9e8a80, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.408855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8df31-82d6-44e1-af6c-f5aa0f0f77bf admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.494315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1129/2265] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:02 2022] PUT /identity/v3/projects/917950a31f9b485bb347864e700c78d6/users/894eaeeacf0f4d7c81d4df7c3c9e8a80/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:02.505382 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7b987-8de5-43d9-9113-183b66916157 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.505665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7b987-8de5-43d9-9113-183b66916157 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.506065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7b987-8de5-43d9-9113-183b66916157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.506162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd746256b1d7472f81df994328df2ed2', 'request_id': 'req-78e56100-dc8f-4a09-9529-722502a03735'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:02.512477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd746256b1d7472f81df994328df2ed2', 'request_id': 'req-78e56100-dc8f-4a09-9529-722502a03735'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:02.534480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a2a7b987-8de5-43d9-9113-183b66916157 None None] MFA Rules not processed for user `894eaeeacf0f4d7c81d4df7c3c9e8a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:02.535739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a2a7b987-8de5-43d9-9113-183b66916157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.597840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd746256b1d7472f81df994328df2ed2', 'request_id': 'req-78e56100-dc8f-4a09-9529-722502a03735'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:02.603172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1130/2266] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:02.614858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] The token cache is being invalidate because project cd746256b1d7472f81df994328df2ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:02.615195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:02.615879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:02.617398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1137/2267] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:02 2022] DELETE /identity/v3/projects/cd746256b1d7472f81df994328df2ed2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:02.622141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12d83-da37-4585-aedb-20d28ce02de8 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.622647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12d83-da37-4585-aedb-20d28ce02de8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.627283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12d83-da37-4585-aedb-20d28ce02de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.640357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.642890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.647980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4bf12d83-da37-4585-aedb-20d28ce02de8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:02.649569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4bf12d83-da37-4585-aedb-20d28ce02de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.717376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1131/2268] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:02.720525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e56100-dc8f-4a09-9529-722502a03735 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.724306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.724915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.725456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.725747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.726807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00f4c-5b96-4c09-9ead-bed066fbf695 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.727129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00f4c-5b96-4c09-9ead-bed066fbf695 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.727451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00f4c-5b96-4c09-9ead-bed066fbf695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.728028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.731826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:02.741405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.742962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.752687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1138/2269] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:49:02.753461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b0c00f4c-5b96-4c09-9ead-bed066fbf695 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:02.755008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b0c00f4c-5b96-4c09-9ead-bed066fbf695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.766822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1132/2270] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:02.767880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.768367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c00f4c-5b96-4c09-9ead-bed066fbf695 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.769253 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.778073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c00f4c-5b96-4c09-9ead-bed066fbf695 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.783083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cab52-b7b0-4017-8caf-b08e29f8cb66 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.783317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.783941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.784216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.784483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.785123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:02.785426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.787010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.787845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.788462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.788742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.789089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] PATH_INFO: `/v3/users/894eaeeacf0f4d7c81d4df7c3c9e8a80` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.790198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=894eaeeacf0f4d7c81d4df7c3c9e8a80)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.794427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.803789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1133/2271] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:49:02.804762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.814760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4235a-fafd-4c93-92af-3b85468fde3d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.819505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.820090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.820365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.820631 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.821252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.823240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.981729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1134/2272] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:02 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:02.986344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.050284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b6a1-24a2-48ba-a0e1-e3123ec4f165 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.055079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.055701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.055975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.056243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.056908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.058980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.114136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894eaeeacf0f4d7c81d4df7c3c9e8a80'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:03.114794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894eaeeacf0f4d7c81d4df7c3c9e8a80'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:03.121918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894eaeeacf0f4d7c81d4df7c3c9e8a80'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:03.124622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:03.186467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1135/2273] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:02 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:03.190262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.200265 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0d5d-c015-4a98-97a4-e88d56eba922 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.205616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.206202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.206639 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.207036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.207848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.208930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894eaeeacf0f4d7c81d4df7c3c9e8a80'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:03.209660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:03.211775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.222990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1136/2274] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:03.226198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-431eb93e-0704-4ffa-87f5-7dcfd12654aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894eaeeacf0f4d7c81d4df7c3c9e8a80'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:03.227236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.229278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:03.231007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1139/2275] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:02 2022] DELETE /identity/v3/users/894eaeeacf0f4d7c81d4df7c3c9e8a80 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:03.235112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.235746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.236026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.243398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94eada0-7bde-4a0a-8cc6-68c8587c03e7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.261452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:03.262629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:03.311714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.311714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.311714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.312153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.312535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.314348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.329446 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1137/2276] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:03.331525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.342407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1140/2277] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:03.347691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18655b53-8c07-45c4-b013-f585b94ac358 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.353554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.354568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.354849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.355726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.355726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] PATH_INFO: `/v3/projects/b6f61315b3334291840d72e80c736d17/users/c194752641ff471f94c33302d4a05c4f/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.357817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:03.377078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f61315b3334291840d72e80c736d17, user_id=c194752641ff471f94c33302d4a05c4f, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.380496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.424035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d6751-e128-4c68-888d-d51d39e3b8e7 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.428591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305cbe6-e14e-461c-871a-001005808113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.429284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305cbe6-e14e-461c-871a-001005808113 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.430204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305cbe6-e14e-461c-871a-001005808113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.430552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305cbe6-e14e-461c-871a-001005808113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.441448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305cbe6-e14e-461c-871a-001005808113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.442876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305cbe6-e14e-461c-871a-001005808113 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.453138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1141/2278] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:49:03.455452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1138/2279] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:03 2022] PUT /identity/v3/projects/b6f61315b3334291840d72e80c736d17/users/c194752641ff471f94c33302d4a05c4f/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:03.468880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae6fec-2d2f-4d93-9518-2f508176cde3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.469168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae6fec-2d2f-4d93-9518-2f508176cde3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.469539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae6fec-2d2f-4d93-9518-2f508176cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.499339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b7ae6fec-2d2f-4d93-9518-2f508176cde3 None None] MFA Rules not processed for user `c194752641ff471f94c33302d4a05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:03.501095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b7ae6fec-2d2f-4d93-9518-2f508176cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:03.519376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:03.574416 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1142/2280] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:03.580122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.622877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:03.649671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988711c6-38f6-4e88-b753-6b32345f0a05 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.655399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.655399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.655624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.655900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.656530 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.658518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.782731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1139/2281] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:03 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:03.791329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae6fec-2d2f-4d93-9518-2f508176cde3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.802141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae6fec-2d2f-4d93-9518-2f508176cde3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.872515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.873192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.873494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.873773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.874423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.876523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.924053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.925959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:03.944774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda59ed-9c05-4f58-8840-41fe5ca368d1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.952601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:03.952601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:03.952601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:03.952601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] PATH_INFO: `/v3/projects/917950a31f9b485bb347864e700c78d6` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:03.953333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917950a31f9b485bb347864e700c78d6)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:03.954870 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:03.978976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1143/2282] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:03 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:03.983741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:03.994207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4e64-1cca-4c09-9a16-3dfe98ee83b1 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:03.999184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.001065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.001065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.001065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.001065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.002679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.013390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1144/2283] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:04.018091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.028587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3030fe0-adbc-45be-acb6-e13df600ad01 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.034163 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.034811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.035222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.035435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] PATH_INFO: `/v3/projects/27231031d50940329796f6d5d066da05/users/f8c056e9a0144e59aa06102ccc8f2353/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.051638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=27231031d50940329796f6d5d066da05, user_id=f8c056e9a0144e59aa06102ccc8f2353, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.054503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.060852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917950a31f9b485bb347864e700c78d6', 'request_id': 'req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:04.067637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917950a31f9b485bb347864e700c78d6', 'request_id': 'req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:04.129520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1145/2284] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:04 2022] PUT /identity/v3/projects/27231031d50940329796f6d5d066da05/users/f8c056e9a0144e59aa06102ccc8f2353/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:04.137822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.180398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:04.181136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917950a31f9b485bb347864e700c78d6', 'request_id': 'req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:04.192670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] The token cache is being invalidate because project 917950a31f9b485bb347864e700c78d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:04.192967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:04.193619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-597d6efe-c87e-4022-93dc-2cb17ab2cfc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:04.195218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1140/2285] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:03 2022] DELETE /identity/v3/projects/917950a31f9b485bb347864e700c78d6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:04.200504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad29a6-02e5-4a35-8c35-5225b89d5efc admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.202510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572884f2-c112-4473-8759-a9892176116d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.202801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572884f2-c112-4473-8759-a9892176116d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.203076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572884f2-c112-4473-8759-a9892176116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.210116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.210116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.210116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.210116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.210430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.210430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.219694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1146/2286] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:04.223662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.225346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:04.225887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-572884f2-c112-4473-8759-a9892176116d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:04.227351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-572884f2-c112-4473-8759-a9892176116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:04.235243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1141/2287] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:04.237854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e59380-f4cb-493d-b489-b360bbb6655c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.243368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc55d0-a98e-4df9-a806-cc1638e4e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.244656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a297-b95a-46aa-9145-2cc8de4b5aa2 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.244764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc55d0-a98e-4df9-a806-cc1638e4e0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.244854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a297-b95a-46aa-9145-2cc8de4b5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.244940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc55d0-a98e-4df9-a806-cc1638e4e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.245037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a297-b95a-46aa-9145-2cc8de4b5aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.245125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc55d0-a98e-4df9-a806-cc1638e4e0d4 admin admin] PATH_INFO: `/v3/projects/27231031d50940329796f6d5d066da05/users/f8c056e9a0144e59aa06102ccc8f2353/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.246579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc55d0-a98e-4df9-a806-cc1638e4e0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27231031d50940329796f6d5d066da05, user_id=f8c056e9a0144e59aa06102ccc8f2353, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.249347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc55d0-a98e-4df9-a806-cc1638e4e0d4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.261749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1147/2288] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:04 2022] PUT /identity/v3/projects/27231031d50940329796f6d5d066da05/users/f8c056e9a0144e59aa06102ccc8f2353/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:04.267342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4c38a297-b95a-46aa-9145-2cc8de4b5aa2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:04.268485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4c38a297-b95a-46aa-9145-2cc8de4b5aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:04.272496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.272787 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.273066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.303778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] MFA Rules not processed for user `f8c056e9a0144e59aa06102ccc8f2353`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:04.305052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:04.331774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1142/2289] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:04.336012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38a297-b95a-46aa-9145-2cc8de4b5aa2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.345171 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38a297-b95a-46aa-9145-2cc8de4b5aa2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.349942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.351119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.351119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.351119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.351893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:04.352197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.353833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.369066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1143/2290] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:49:04.370037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.377281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1148/2291] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:04.380387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ada8c-e22a-4c1f-84b3-d9bf75ea2d21 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.385222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.385814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.386090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.386379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.386991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.388928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.389194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.390567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:04.450533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ec90-1ec2-4bd1-b755-eca179221b75 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.454196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.454798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.455078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.455647 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.457152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:04.496645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1144/2292] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:04 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:04.500885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.529932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.532563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.542632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1149/2293] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:49:04.582986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce574b89-e879-4e55-8288-d6e4f724a444 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.589348 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.589979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.590270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.590529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.591191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.593139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.637435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:04.661646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1145/2294] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:04 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:04.665082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.677509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2e860-6f7e-4c5e-a384-f7221572730a service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.682162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.682772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.683051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.683367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.684021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.685641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.696172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1150/2295] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:04.700519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.711123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942012-02ae-47c1-9ddd-5b6464e6be1b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.715871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07afcc0-8c84-4d4a-8ea7-0926910c87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.716469 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afcc0-8c84-4d4a-8ea7-0926910c87c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.716748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afcc0-8c84-4d4a-8ea7-0926910c87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.717023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afcc0-8c84-4d4a-8ea7-0926910c87c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.717664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07afcc0-8c84-4d4a-8ea7-0926910c87c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.719318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07afcc0-8c84-4d4a-8ea7-0926910c87c6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.730518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1146/2296] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:04.734687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.745063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cc7ec-2f98-437a-aab2-a1c142595a90 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:04.749891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:04.750554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.750843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.751125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] PATH_INFO: `/v3/projects/f4a65f5263734e75a8932995baa8ab5f/users/86064d641dc34603a4b7436ae6219755/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.767932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a65f5263734e75a8932995baa8ab5f, user_id=86064d641dc34603a4b7436ae6219755, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:04.770642 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:04.854095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1151/2297] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:04 2022] PUT /identity/v3/projects/f4a65f5263734e75a8932995baa8ab5f/users/86064d641dc34603a4b7436ae6219755/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:04.859466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36061c0-992c-4a33-a7d8-58597d07029d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:04.859816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36061c0-992c-4a33-a7d8-58597d07029d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:04.860154 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36061c0-992c-4a33-a7d8-58597d07029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:04.881288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a36061c0-992c-4a33-a7d8-58597d07029d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:04.882496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a36061c0-992c-4a33-a7d8-58597d07029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:04.941197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1147/2298] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:04.950864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:04.955831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:05.010480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e223d6-5a84-49e0-a21b-06e729ba83ad admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:05.014160 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cfc69-a0da-4355-b5df-79477889f70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:05.014767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cfc69-a0da-4355-b5df-79477889f70e service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:05.015046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cfc69-a0da-4355-b5df-79477889f70e service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:05.015359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cfc69-a0da-4355-b5df-79477889f70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:05.025145 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cfc69-a0da-4355-b5df-79477889f70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:05.026759 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cfc69-a0da-4355-b5df-79477889f70e service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:05.037488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1152/2299] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:05.294249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:05.729008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:06.157531 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:06.614782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:06.748331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:07.461957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:08.592293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:09.049648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36061c0-992c-4a33-a7d8-58597d07029d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:09.061533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36061c0-992c-4a33-a7d8-58597d07029d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:09.068249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:09.068249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:09.068249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:09.068774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] PATH_INFO: `/v3/users/c194752641ff471f94c33302d4a05c4f` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:09.082929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c194752641ff471f94c33302d4a05c4f)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:09.085204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:09.096546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:09.349129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c194752641ff471f94c33302d4a05c4f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:09.362247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c194752641ff471f94c33302d4a05c4f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:09.369682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c194752641ff471f94c33302d4a05c4f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:09.370426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c194752641ff471f94c33302d4a05c4f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:09.371056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c194752641ff471f94c33302d4a05c4f'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:09.495033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1148/2300] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:09 2022] DELETE /identity/v3/users/c194752641ff471f94c33302d4a05c4f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:09.499383 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:09.499651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:09.499934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:09.523782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:09.525110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:09.619925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1153/2301] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:09.639905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:09.642013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:09.707501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f553f-55a3-4a53-b37a-dd70d8bfdc50 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:09.712324 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:09.712712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:09.713405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:09.713405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:09.728473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:09.728473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:09.738264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1149/2302] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:10.152404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:10.333617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:10.335087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:10.354954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac706e-d188-41c0-90b3-84140ebd408e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:10.366142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:10.366142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:10.366142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:10.366142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] PATH_INFO: `/v3/projects/b6f61315b3334291840d72e80c736d17` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:10.366566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f61315b3334291840d72e80c736d17)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:10.367834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:10.537888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f61315b3334291840d72e80c736d17', 'request_id': 'req-c8936349-eb8b-43c0-82fb-6baf0975719e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:10.545007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f61315b3334291840d72e80c736d17', 'request_id': 'req-c8936349-eb8b-43c0-82fb-6baf0975719e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:10.617453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f61315b3334291840d72e80c736d17', 'request_id': 'req-c8936349-eb8b-43c0-82fb-6baf0975719e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:10.650263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] The token cache is being invalidate because project b6f61315b3334291840d72e80c736d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:10.650744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:10.661263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c8936349-eb8b-43c0-82fb-6baf0975719e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:10.670978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:10.672024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1154/2303] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:10 2022] DELETE /identity/v3/projects/b6f61315b3334291840d72e80c736d17 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:10.684591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2924b-ad87-44d0-9295-60988fc5af68 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:10.787876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:10.793671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:10.793671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:10.793671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] PATH_INFO: `/v3/users/f8c056e9a0144e59aa06102ccc8f2353` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:10.793671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c056e9a0144e59aa06102ccc8f2353)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:10.793671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:11.032161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c056e9a0144e59aa06102ccc8f2353'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:11.047536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c056e9a0144e59aa06102ccc8f2353'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:11.055768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c056e9a0144e59aa06102ccc8f2353'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:11.056883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c056e9a0144e59aa06102ccc8f2353'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:11.057641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c056e9a0144e59aa06102ccc8f2353'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:11.140819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:11.148473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1150/2304] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:10 2022] DELETE /identity/v3/users/f8c056e9a0144e59aa06102ccc8f2353 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:11.228954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6267f2-d54c-45a8-8025-93ba3b20917a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:11.229878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6267f2-d54c-45a8-8025-93ba3b20917a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:11.231005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6267f2-d54c-45a8-8025-93ba3b20917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:11.287476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ff6267f2-d54c-45a8-8025-93ba3b20917a None None] MFA Rules not processed for user `86064d641dc34603a4b7436ae6219755`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:11.288702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ff6267f2-d54c-45a8-8025-93ba3b20917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:11.372238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1155/2305] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:11.377496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:11.380995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:11.457417 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2618697-a1e2-4684-ab28-483e0e647622 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:11.463512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:11.464496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:11.464846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:11.465184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:11.465911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:11.468425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:11.578222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1151/2306] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:11 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:11.582039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6267f2-d54c-45a8-8025-93ba3b20917a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:11.598596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6267f2-d54c-45a8-8025-93ba3b20917a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:11.686452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:11.687405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:11.687890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:11.688393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:11.689326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:11.691446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:11.795618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1156/2307] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:11 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:11.796807 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:11.820722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc7d1-bd9c-48fa-b73d-73540f6b557d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:11.830393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:11.830393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:11.831413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:11.831823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:11.832644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:11.834381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:11.846570 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1152/2308] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:11.850902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:11.863945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe3a7c-5ea6-4e64-96f8-0f378366d3d4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:11.868729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:11.869390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:11.869666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:11.869939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] PATH_INFO: `/v3/projects/6719850efb1a4310b29eff781f0c008d/users/46eb2787a3fd4dccba0dc1c372ee9c29/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:11.892828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6719850efb1a4310b29eff781f0c008d, user_id=46eb2787a3fd4dccba0dc1c372ee9c29, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:11.895668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.010361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.012537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:12.029890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d0eed-ec27-4a9f-85ee-0a22ac1d5d31 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.036335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1157/2309] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:11 2022] PUT /identity/v3/projects/6719850efb1a4310b29eff781f0c008d/users/46eb2787a3fd4dccba0dc1c372ee9c29/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:12.040202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.114649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.115296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.115620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.121045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] PATH_INFO: `/v3/projects/27231031d50940329796f6d5d066da05` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.121045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27231031d50940329796f6d5d066da05)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.121045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.122810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49da215-a3e4-437f-a1eb-90583455567a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.127661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.128215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.128494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.128767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.129411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.131281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.143287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1158/2310] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:12.147149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.157959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47980-a6a3-44e9-9c5a-f3a1305b5310 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.162836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945be79e-ba34-475d-8e5c-c4aaf2f1148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.163505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be79e-ba34-475d-8e5c-c4aaf2f1148c admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.163892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be79e-ba34-475d-8e5c-c4aaf2f1148c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.164172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be79e-ba34-475d-8e5c-c4aaf2f1148c admin admin] PATH_INFO: `/v3/projects/6719850efb1a4310b29eff781f0c008d/users/46eb2787a3fd4dccba0dc1c372ee9c29/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.166089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945be79e-ba34-475d-8e5c-c4aaf2f1148c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6719850efb1a4310b29eff781f0c008d, user_id=46eb2787a3fd4dccba0dc1c372ee9c29, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.168779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945be79e-ba34-475d-8e5c-c4aaf2f1148c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.181440 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1159/2311] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:12 2022] PUT /identity/v3/projects/6719850efb1a4310b29eff781f0c008d/users/46eb2787a3fd4dccba0dc1c372ee9c29/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:12.255194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27231031d50940329796f6d5d066da05', 'request_id': 'req-53ea9900-2590-467c-8718-74c8727a367d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:12.261498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27231031d50940329796f6d5d066da05', 'request_id': 'req-53ea9900-2590-467c-8718-74c8727a367d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:12.271333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:12.342799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27231031d50940329796f6d5d066da05', 'request_id': 'req-53ea9900-2590-467c-8718-74c8727a367d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:12.361254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] The token cache is being invalidate because project 27231031d50940329796f6d5d066da05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:12.361546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:12.362288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-53ea9900-2590-467c-8718-74c8727a367d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:12.368098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1153/2312] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:12 2022] DELETE /identity/v3/projects/27231031d50940329796f6d5d066da05 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:12.369630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5dff0-e6a9-4976-aca1-31b05d1b375f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.369918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5dff0-e6a9-4976-aca1-31b05d1b375f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.370192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5dff0-e6a9-4976-aca1-31b05d1b375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.394447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4eb5dff0-e6a9-4976-aca1-31b05d1b375f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:12.395854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4eb5dff0-e6a9-4976-aca1-31b05d1b375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:12.461246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1160/2313] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:12.469784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eace7-9160-46dc-98a2-1f284d2a9e72 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.470066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eace7-9160-46dc-98a2-1f284d2a9e72 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.470320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eace7-9160-46dc-98a2-1f284d2a9e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.489848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-260eace7-9160-46dc-98a2-1f284d2a9e72 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:12.491062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-260eace7-9160-46dc-98a2-1f284d2a9e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:12.506762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1154/2314] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:12.507725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5dff0-e6a9-4976-aca1-31b05d1b375f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.529782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5dff0-e6a9-4976-aca1-31b05d1b375f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.543727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.544355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.544632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.544900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.545555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:12.545860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.547480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.573598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1161/2315] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:49:12.578006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eace7-9160-46dc-98a2-1f284d2a9e72 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.588175 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eace7-9160-46dc-98a2-1f284d2a9e72 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.593751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.594602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.594976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.595392 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.596224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.598233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.714208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1155/2316] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:12 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:12.718553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.730417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90288-26d1-43a2-8bfa-d305c5370668 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.800557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.801961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.802319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.803530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.804510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.806632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.907281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1162/2317] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:12 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:12.910100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.921852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111175ae-edf3-431a-86a5-64c0308d4c83 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.929233 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.930116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.930549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.931092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.932017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.934078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.949946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1156/2318] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:12.954350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:12.966509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5cd5b-073a-49cf-b05e-dd2075945c1c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:12.971817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db34e0-88d7-4fc4-8ac9-61ef479e98cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:12.972586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db34e0-88d7-4fc4-8ac9-61ef479e98cb admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:12.973471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db34e0-88d7-4fc4-8ac9-61ef479e98cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:12.974025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db34e0-88d7-4fc4-8ac9-61ef479e98cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:12.974832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db34e0-88d7-4fc4-8ac9-61ef479e98cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:12.976458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db34e0-88d7-4fc4-8ac9-61ef479e98cb admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:12.991768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1163/2319] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:12.996482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:13.009971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6b16-62fe-4ede-9631-17f7eac324ae admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:13.017214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:13.017915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:13.018153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:13.018677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] PATH_INFO: `/v3/projects/75d65fd2cfa14444b03344165c115dc3/users/b399f0f200154e368b2c5d38c38ceac7/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:13.049822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d65fd2cfa14444b03344165c115dc3, user_id=b399f0f200154e368b2c5d38c38ceac7, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:13.053941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:13.135119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1157/2320] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:12 2022] PUT /identity/v3/projects/75d65fd2cfa14444b03344165c115dc3/users/b399f0f200154e368b2c5d38c38ceac7/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:13.145958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75f86-95fd-4f3d-902b-81dd048376c3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:13.145958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75f86-95fd-4f3d-902b-81dd048376c3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:13.146237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75f86-95fd-4f3d-902b-81dd048376c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:13.175765 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-98d75f86-95fd-4f3d-902b-81dd048376c3 None None] MFA Rules not processed for user `b399f0f200154e368b2c5d38c38ceac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:13.176906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-98d75f86-95fd-4f3d-902b-81dd048376c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:13.242751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1164/2321] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:13.254914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:13.256755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:13.316418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad65da-3fee-4a4f-b57d-533027264929 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:13.320366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8243f-ce9f-4d86-b2dc-7156bde53af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:13.320983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8243f-ce9f-4d86-b2dc-7156bde53af2 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:13.321262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8243f-ce9f-4d86-b2dc-7156bde53af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:13.321534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8243f-ce9f-4d86-b2dc-7156bde53af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:13.331256 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8243f-ce9f-4d86-b2dc-7156bde53af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:13.332135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8243f-ce9f-4d86-b2dc-7156bde53af2 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:13.342489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1158/2322] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:13.568876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:14.111935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:15.260890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:16.203921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:17.061706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:17.346258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:17.717354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75f86-95fd-4f3d-902b-81dd048376c3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:17.809615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75f86-95fd-4f3d-902b-81dd048376c3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:17.819509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:17.820502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:17.821221 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:17.821653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] PATH_INFO: `/v3/users/b399f0f200154e368b2c5d38c38ceac7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:17.823019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b399f0f200154e368b2c5d38c38ceac7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:17.825512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:18.037598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b399f0f200154e368b2c5d38c38ceac7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:18.038367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b399f0f200154e368b2c5d38c38ceac7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:18.046163 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b399f0f200154e368b2c5d38c38ceac7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:18.127318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b399f0f200154e368b2c5d38c38ceac7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:18.154435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b399f0f200154e368b2c5d38c38ceac7'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:18.169698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1165/2323] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:17 2022] DELETE /identity/v3/users/b399f0f200154e368b2c5d38c38ceac7 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:18.178368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc475a53-edc2-4940-978a-a6ece25ab6ed None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:18.178928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc475a53-edc2-4940-978a-a6ece25ab6ed None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:18.178928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc475a53-edc2-4940-978a-a6ece25ab6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:18.236832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-fc475a53-edc2-4940-978a-a6ece25ab6ed None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:18.238117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-fc475a53-edc2-4940-978a-a6ece25ab6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:18.310945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:18.348180 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1159/2324] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:18.359018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:18.360599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:18.448530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:18.493355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1b36-f19a-4135-9032-289c6cc79a30 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:18.501423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:18.501423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:18.501423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:18.501423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:18.513557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:18.515302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:18.532614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1166/2325] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:18.554191 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:18.554683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:18.555124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:18.587196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] MFA Rules not processed for user `46eb2787a3fd4dccba0dc1c372ee9c29`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:18.588799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:18.712003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1160/2326] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:18.721295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:18.724762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:18.823719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424addcc-4778-4812-a311-f0866769f2d3 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:18.827697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ffba6-e124-4a65-ab98-e68f144322d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:18.828378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ffba6-e124-4a65-ab98-e68f144322d5 service glance] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:18.828722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ffba6-e124-4a65-ab98-e68f144322d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:18.829092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ffba6-e124-4a65-ab98-e68f144322d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:18.830943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-886ffba6-e124-4a65-ab98-e68f144322d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:18.902727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ffba6-e124-4a65-ab98-e68f144322d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:18.904992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ffba6-e124-4a65-ab98-e68f144322d5 service glance] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:18.916084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1167/2327] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:19.022535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:19.028491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:19.066148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232067ec-47c5-4ced-aca1-d53aea0f88f6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:19.072199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:19.072846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:19.073119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:19.073385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] PATH_INFO: `/v3/projects/75d65fd2cfa14444b03344165c115dc3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:19.074606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d65fd2cfa14444b03344165c115dc3)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:19.076625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:19.080666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:19.232334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:19.236198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d65fd2cfa14444b03344165c115dc3', 'request_id': 'req-dd2f67db-97bf-44b3-b981-fe805c210be2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:19.243107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d65fd2cfa14444b03344165c115dc3', 'request_id': 'req-dd2f67db-97bf-44b3-b981-fe805c210be2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:19.274819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:19.275099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:19.275398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:19.295629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:19.296849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:19.340401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d65fd2cfa14444b03344165c115dc3', 'request_id': 'req-dd2f67db-97bf-44b3-b981-fe805c210be2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:19.357683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] The token cache is being invalidate because project 75d65fd2cfa14444b03344165c115dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:19.357971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:19.358834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:19.376253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1161/2328] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:19 2022] DELETE /identity/v3/projects/75d65fd2cfa14444b03344165c115dc3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:19.379399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1168/2329] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:49:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:19.441430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:19.441430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:19.490721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:19.596607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f67db-97bf-44b3-b981-fe805c210be2 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:19.596607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce39f7e-8d71-4003-ab79-ec2eca2835fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:19.596607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39f7e-8d71-4003-ab79-ec2eca2835fc service swift] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:19.596607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39f7e-8d71-4003-ab79-ec2eca2835fc service swift] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:19.597009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39f7e-8d71-4003-ab79-ec2eca2835fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:19.606355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce39f7e-8d71-4003-ab79-ec2eca2835fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:19.608063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce39f7e-8d71-4003-ab79-ec2eca2835fc service swift] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:19.618094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1162/2330] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:49:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:49:19.763960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:19.809026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:19.960386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:19.961946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:20.051559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a018a6-3cfc-415f-95f2-8507027b250e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:20.056651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:20.057965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:20.058395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:20.058823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] PATH_INFO: `/v3/users/5f99b3ba1d104586b42e168f9975bc2c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:20.060182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f99b3ba1d104586b42e168f9975bc2c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:20.062206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:20.257791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f99b3ba1d104586b42e168f9975bc2c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:20.258724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f99b3ba1d104586b42e168f9975bc2c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:20.273954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f99b3ba1d104586b42e168f9975bc2c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:20.345921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f99b3ba1d104586b42e168f9975bc2c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:20.364481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f99b3ba1d104586b42e168f9975bc2c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:20.373648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1169/2331] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:19 2022] DELETE /identity/v3/users/5f99b3ba1d104586b42e168f9975bc2c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:20.375720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:20.376739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:20.377022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:20.403470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:20.405894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:20.499306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1163/2332] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:20.510462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:20.510462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:20.604237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff0177-4edb-48ad-a04e-5118754660b4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:20.613902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81609a1c-bcb1-40ef-9923-144ba30f5fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:20.615493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609a1c-bcb1-40ef-9923-144ba30f5fde service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:20.617017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609a1c-bcb1-40ef-9923-144ba30f5fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:20.617017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81609a1c-bcb1-40ef-9923-144ba30f5fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:20.633366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81609a1c-bcb1-40ef-9923-144ba30f5fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:20.634809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81609a1c-bcb1-40ef-9923-144ba30f5fde service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:20.641451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:20.650998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1170/2333] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:20.704018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:20.900583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:21.902458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:21.904848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:21.935645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f820-e640-494c-96d9-66e42b3cf6b2 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:21.960220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:21.962850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:21.965031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:21.966141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] PATH_INFO: `/v3/projects/05364811d6384abf869898e61f91b517` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:21.972879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05364811d6384abf869898e61f91b517)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:21.972879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:22.161204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05364811d6384abf869898e61f91b517', 'request_id': 'req-81ae660e-80e5-44a8-b911-fba605f46c12'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:22.170538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05364811d6384abf869898e61f91b517', 'request_id': 'req-81ae660e-80e5-44a8-b911-fba605f46c12'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:22.282641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05364811d6384abf869898e61f91b517', 'request_id': 'req-81ae660e-80e5-44a8-b911-fba605f46c12'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:22.295524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] The token cache is being invalidate because project 05364811d6384abf869898e61f91b517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:22.296061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:22.296954 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-81ae660e-80e5-44a8-b911-fba605f46c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:22.299048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1164/2334] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:21 2022] DELETE /identity/v3/projects/05364811d6384abf869898e61f91b517 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:22.305312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7b0d5-9d4a-4cbb-b6a9-0576170e96b1 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:22.305894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7b0d5-9d4a-4cbb-b6a9-0576170e96b1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:22.306148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7b0d5-9d4a-4cbb-b6a9-0576170e96b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:22.336724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0ca7b0d5-9d4a-4cbb-b6a9-0576170e96b1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:22.338330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0ca7b0d5-9d4a-4cbb-b6a9-0576170e96b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:22.359209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:22.431856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:22.453135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1171/2335] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:22.462904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb675-6207-483e-9699-3811b36a27ac None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:22.463271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb675-6207-483e-9699-3811b36a27ac None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:22.463479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb675-6207-483e-9699-3811b36a27ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:22.483201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-bfefb675-6207-483e-9699-3811b36a27ac None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:22.493123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bfefb675-6207-483e-9699-3811b36a27ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:22.502415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1165/2336] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:22.528152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7b0d5-9d4a-4cbb-b6a9-0576170e96b1 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:22.537939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7b0d5-9d4a-4cbb-b6a9-0576170e96b1 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:22.546460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:22.547062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:22.547372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:22.548181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:22.548873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:22.549194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:22.551132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:22.563961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1172/2337] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:49:22.568313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefb675-6207-483e-9699-3811b36a27ac None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:22.577507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefb675-6207-483e-9699-3811b36a27ac None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:22.582576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:22.583217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:22.583500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:22.583772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:22.584413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:22.586394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:22.932268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1166/2338] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:22 2022] POST /identity/v3/projects => generated 383 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:22.936190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:22.951270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155019c-e94e-4c7c-9670-ff89faccde69 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:23.052082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:23.052880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:23.053223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:23.053565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:23.054488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:23.056883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:23.202091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1173/2339] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:22 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:23.202497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:23.214587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068574c7-b55d-4638-bf66-268f168eec05 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:23.222253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:23.222911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:23.223430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:23.224355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:23.225215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:23.227007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:23.242547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1167/2340] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:23.251544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:23.263077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff718-5805-4d95-a150-b94a334cc0b9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:23.277511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe246-7297-4521-bd3d-33e94b70d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:23.288890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe246-7297-4521-bd3d-33e94b70d1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:23.288890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe246-7297-4521-bd3d-33e94b70d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:23.288890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe246-7297-4521-bd3d-33e94b70d1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:23.288890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe246-7297-4521-bd3d-33e94b70d1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:23.288890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe246-7297-4521-bd3d-33e94b70d1d4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:23.310189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1174/2341] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:23.314494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:23.331077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29fef4-e2d4-4e6d-9dc8-40dd1ebf75dd admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:23.338037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:23.338956 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:23.341268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:23.341765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] PATH_INFO: `/v3/projects/a930c9e6e5e74fe4a4b8991b794fd13f/users/e54421f9b06144c2abb2848b1fdd419e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:23.373808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a930c9e6e5e74fe4a4b8991b794fd13f, user_id=e54421f9b06144c2abb2848b1fdd419e, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:23.377420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:23.491987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1168/2342] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:23 2022] PUT /identity/v3/projects/a930c9e6e5e74fe4a4b8991b794fd13f/users/e54421f9b06144c2abb2848b1fdd419e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:23.494804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:23.502822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e661da-2c39-4921-b63b-83ace3c36c71 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:23.508038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e661da-2c39-4921-b63b-83ace3c36c71 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:23.508038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e661da-2c39-4921-b63b-83ace3c36c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:23.563926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:23.568131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-96e661da-2c39-4921-b63b-83ace3c36c71 None None] MFA Rules not processed for user `e54421f9b06144c2abb2848b1fdd419e`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:23.574404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-96e661da-2c39-4921-b63b-83ace3c36c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:23.683979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:23.685097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1175/2343] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:23.771615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8d480-7104-488c-b536-6a9f04bb73a5 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:23.786018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:23.786738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:23.787093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:23.787515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:23.788276 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:23.790295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:23.944690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1169/2344] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:23 2022] POST /identity/v3/projects => generated 383 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:23.948794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e661da-2c39-4921-b63b-83ace3c36c71 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:24.025272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e661da-2c39-4921-b63b-83ace3c36c71 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:24.158425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:24.159287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.159572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.159855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.160516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:24.163249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:24.191541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:24.262892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1176/2345] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:23 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:24.263860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:24.278026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1172-9b69-445e-847f-05253c095b40 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:24.285091 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:24.289479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.289479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.289479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.289479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:24.290262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:24.330640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1170/2346] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:24.334488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:24.343355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879152-b59f-4a67-8146-62a7721861ad admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:24.383265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20091d8-ee32-4e47-9703-b0f2ca32135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:24.383895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20091d8-ee32-4e47-9703-b0f2ca32135e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.386058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20091d8-ee32-4e47-9703-b0f2ca32135e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.386335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20091d8-ee32-4e47-9703-b0f2ca32135e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.387558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20091d8-ee32-4e47-9703-b0f2ca32135e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:24.389710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20091d8-ee32-4e47-9703-b0f2ca32135e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:24.418907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1177/2347] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:24.423717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:24.436811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568b4f1-d8c8-4bbd-838b-874d1496aa18 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:24.443222 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:24.448610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.448610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.448610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] PATH_INFO: `/v3/projects/b63fd084267f42cd815382201ce80b8a/users/8083743df83e4aefba8398a77352fb34/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.465919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63fd084267f42cd815382201ce80b8a, user_id=8083743df83e4aefba8398a77352fb34, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:24.471919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:24.562747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1171/2348] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:24 2022] PUT /identity/v3/projects/b63fd084267f42cd815382201ce80b8a/users/8083743df83e4aefba8398a77352fb34/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:24.565493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b98c-5a89-449f-8ee2-40b8be593c9e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.565785 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b98c-5a89-449f-8ee2-40b8be593c9e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.566063 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4b98c-5a89-449f-8ee2-40b8be593c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.598737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-2cf4b98c-5a89-449f-8ee2-40b8be593c9e None None] MFA Rules not processed for user `8083743df83e4aefba8398a77352fb34`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:24.599925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2cf4b98c-5a89-449f-8ee2-40b8be593c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:24.693180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:24.698834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1178/2349] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:24.704035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:24.780624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5525e-f5a8-4447-b819-296b3191005b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:24.786301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:24.786965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.787281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.787566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.788212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:24.790156 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:24.886508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1172/2350] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:24 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:24.887641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b98c-5a89-449f-8ee2-40b8be593c9e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:24.902359 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4b98c-5a89-449f-8ee2-40b8be593c9e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:24.940306 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:24.971897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:24.976070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:24.976070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:24.976070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:24.976070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:24.976070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:24.997295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:25.100758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1179/2351] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:24 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:25.101736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:25.113186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f9760-9d2f-437d-9a86-7a13942a0dd6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:25.120236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:25.121200 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:25.121533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:25.121872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:25.122588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:25.124307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:25.146036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1173/2352] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:25.146256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:25.158233 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ccca6-a83a-4ca2-b856-0dc08f6f760d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:25.165806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:25.171120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:25.171120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:25.171120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] PATH_INFO: `/v3/projects/0075d53489a5450cb8bc9178a51379c4/users/f811cb9c4e944569b9beea7ea8ee1cc5/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:25.189644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0075d53489a5450cb8bc9178a51379c4, user_id=f811cb9c4e944569b9beea7ea8ee1cc5, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:25.192784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:25.278088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1180/2353] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:25 2022] PUT /identity/v3/projects/0075d53489a5450cb8bc9178a51379c4/users/f811cb9c4e944569b9beea7ea8ee1cc5/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:25.282468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:25.293706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb83a6-b83c-40f5-979e-cb08cd18eeba admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:25.369576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defab95-71d2-4c0d-bb7e-ac3975d9336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:25.370241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defab95-71d2-4c0d-bb7e-ac3975d9336f admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:25.370520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defab95-71d2-4c0d-bb7e-ac3975d9336f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:25.370796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defab95-71d2-4c0d-bb7e-ac3975d9336f admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:25.371467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defab95-71d2-4c0d-bb7e-ac3975d9336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:25.373588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defab95-71d2-4c0d-bb7e-ac3975d9336f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:25.383350 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:25.394413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:25.400739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1174/2354] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:25.407613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22ccb-1bb1-4f14-aea1-fb1afec7069b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:25.410295 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:25.414905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:25.416001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:25.416435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:25.416811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] PATH_INFO: `/v3/projects/0075d53489a5450cb8bc9178a51379c4/users/f811cb9c4e944569b9beea7ea8ee1cc5/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:25.419259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0075d53489a5450cb8bc9178a51379c4, user_id=f811cb9c4e944569b9beea7ea8ee1cc5, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:25.423413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:25.441287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1181/2355] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:25 2022] PUT /identity/v3/projects/0075d53489a5450cb8bc9178a51379c4/users/f811cb9c4e944569b9beea7ea8ee1cc5/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:25.519064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:25.520264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:25.520264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:25.559118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] MFA Rules not processed for user `f811cb9c4e944569b9beea7ea8ee1cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:25.582783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:25.729743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:25.735518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1175/2356] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:25.748071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:25.749934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:25.858781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56ad25-5242-4485-95ae-e692e1b040fe admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:25.863023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e6ae8-f401-4793-bd57-b75348e1b7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:25.866961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6ae8-f401-4793-bd57-b75348e1b7dd service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:25.866961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6ae8-f401-4793-bd57-b75348e1b7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:25.866961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6ae8-f401-4793-bd57-b75348e1b7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:25.896811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:25.941939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e6ae8-f401-4793-bd57-b75348e1b7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:25.943925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e6ae8-f401-4793-bd57-b75348e1b7dd service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:25.955782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1182/2357] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:27.106566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:27.355893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:27.791994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:27.820848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.134780 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.158040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.266364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.381089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.580936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.751665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:28.912022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.003825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.026484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.311696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.364602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.626382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.668676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:29.672223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:29.685493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255efe48-813f-423b-83eb-9a3980568ee6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:29.689255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:29.689884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:29.690159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:29.690431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:29.748828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:29.760852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:29.764261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:29.799884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1176/2358] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:30.997662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:31.489497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:31.613422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116bbe-21f7-4b1d-810b-dc968a3b506e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:31.613897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116bbe-21f7-4b1d-810b-dc968a3b506e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:31.615318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116bbe-21f7-4b1d-810b-dc968a3b506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:31.634033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ae116bbe-21f7-4b1d-810b-dc968a3b506e None None] MFA Rules not processed for user `86064d641dc34603a4b7436ae6219755`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:31.635272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ae116bbe-21f7-4b1d-810b-dc968a3b506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:31.692361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1183/2359] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:32.069920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:32.080411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861f481-0253-4608-bee9-e6b4d0b48dd8 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:32.084617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:32.085227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:32.085653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:32.086120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:32.096192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:32.097699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:32.107669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1177/2360] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:49:35.698073 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:35.698649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:35.698649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:35.719112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:35.720545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:35.783955 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1184/2361] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:35.796443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:35.797908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:35.872776 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf46b8-9b82-4a16-a0dd-53c137c8a612 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:35.878836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66a0e2-f7a8-4d2a-a93e-b9b48db8724f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:35.879568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a0e2-f7a8-4d2a-a93e-b9b48db8724f service swift] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:35.879868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a0e2-f7a8-4d2a-a93e-b9b48db8724f service swift] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:35.880158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a0e2-f7a8-4d2a-a93e-b9b48db8724f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:35.889147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66a0e2-f7a8-4d2a-a93e-b9b48db8724f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:35.890906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66a0e2-f7a8-4d2a-a93e-b9b48db8724f service swift] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:35.900074 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1178/2362] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:49:36.580922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:36.581669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:36.668444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8998b-d1a3-43f2-92e4-d72aca96e0b6 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:36.691698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:36.693609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:36.693890 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:36.694166 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] PATH_INFO: `/v3/users/c677776ba4e448f297e590f55f03cea0` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:36.698927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c677776ba4e448f297e590f55f03cea0)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:36.700923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:36.867301 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:37.029026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c677776ba4e448f297e590f55f03cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:37.029775 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c677776ba4e448f297e590f55f03cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:37.042612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c677776ba4e448f297e590f55f03cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:37.116840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c677776ba4e448f297e590f55f03cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:37.135759 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c677776ba4e448f297e590f55f03cea0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:37.142702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1185/2363] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:36 2022] DELETE /identity/v3/users/c677776ba4e448f297e590f55f03cea0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:37.147554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:37.148066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:37.148341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:37.169812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:37.171022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:37.177063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:37.259167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1179/2364] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:37.269285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:37.270796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:37.333179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016761-1588-48eb-bdfa-609f62400c57 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:37.336817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1e1ee-85b2-4dc2-809d-c8fb95c6b8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:37.337425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e1ee-85b2-4dc2-809d-c8fb95c6b8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:37.337753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e1ee-85b2-4dc2-809d-c8fb95c6b8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:37.338028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e1ee-85b2-4dc2-809d-c8fb95c6b8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:37.347885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1e1ee-85b2-4dc2-809d-c8fb95c6b8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:37.349309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1e1ee-85b2-4dc2-809d-c8fb95c6b8d2 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:37.358573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1186/2365] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:37.876072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:37.878213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:37.893730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec517572-1d32-4a47-8323-e4e99823e14d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:37.900889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:37.901778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:37.902155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:37.902523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] PATH_INFO: `/v3/projects/ea7818e397cd43e3a6510e9f5f66aa85` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:37.903919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7818e397cd43e3a6510e9f5f66aa85)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:37.906300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.007922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7818e397cd43e3a6510e9f5f66aa85', 'request_id': 'req-f9952319-f2eb-46ab-9b9e-eec66e20d001'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.014693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7818e397cd43e3a6510e9f5f66aa85', 'request_id': 'req-f9952319-f2eb-46ab-9b9e-eec66e20d001'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.072291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7818e397cd43e3a6510e9f5f66aa85', 'request_id': 'req-f9952319-f2eb-46ab-9b9e-eec66e20d001'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.090693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] The token cache is being invalidate because project ea7818e397cd43e3a6510e9f5f66aa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:38.091365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.092194 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.093905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1180/2366] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:37 2022] DELETE /identity/v3/projects/ea7818e397cd43e3a6510e9f5f66aa85 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:38.099865 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02576e-42d8-4aa2-bd04-221da4c49357 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.100376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02576e-42d8-4aa2-bd04-221da4c49357 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.100494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02576e-42d8-4aa2-bd04-221da4c49357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.161012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ce02576e-42d8-4aa2-bd04-221da4c49357 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:38.163977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ce02576e-42d8-4aa2-bd04-221da4c49357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:38.182943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.184604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:38.245052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1187/2367] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:38.253833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dafd4-8c92-49e4-ab73-6f146be99122 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.254118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dafd4-8c92-49e4-ab73-6f146be99122 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.254395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dafd4-8c92-49e4-ab73-6f146be99122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.260749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952319-f2eb-46ab-9b9e-eec66e20d001 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.265573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.266195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.266477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.266746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] PATH_INFO: `/v3/users/e54421f9b06144c2abb2848b1fdd419e` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.268539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54421f9b06144c2abb2848b1fdd419e)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.270466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.274766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-2d4dafd4-8c92-49e4-ab73-6f146be99122 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:38.276032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2d4dafd4-8c92-49e4-ab73-6f146be99122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:38.284014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1188/2368] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:49:38.288196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dafd4-8c92-49e4-ab73-6f146be99122 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.297386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dafd4-8c92-49e4-ab73-6f146be99122 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.303058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.306524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.306524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.306524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.306524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:38.306524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.307228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.329389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1189/2369] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:49:38.331305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.342382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9ec85-3a01-441a-a6ad-96ecd82aaa41 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.349232 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.349852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.350129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.350399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.351035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.353096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.483042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:38.491127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54421f9b06144c2abb2848b1fdd419e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.501731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1190/2370] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:38 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:38.507779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54421f9b06144c2abb2848b1fdd419e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.508863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.514867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54421f9b06144c2abb2848b1fdd419e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.515712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54421f9b06144c2abb2848b1fdd419e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.516325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-07d76aa8-e677-4c5d-a371-732c3f3f1604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54421f9b06144c2abb2848b1fdd419e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:38.516483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:38.582444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af2add-5d52-471a-a56e-624b10ed5a1f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.587936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.588781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.589277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.589652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.590582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.593318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.609065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1181/2371] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:38 2022] DELETE /identity/v3/users/e54421f9b06144c2abb2848b1fdd419e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:38.613426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.613784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.614061 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.634195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:38.635909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:38.696176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1182/2372] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:38.706044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.707444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:38.728201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1191/2373] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:38 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:38.729284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.731120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:38.745760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42912-9525-4d21-86a4-f7955f75f8ff admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.752885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.753500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.753779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.754048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.754695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.756605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.768152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1192/2374] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:38.772120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.780108 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cfe1e-07b4-46e2-a6f8-b0cbe3d41d25 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.782889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec57e-5562-4eb0-b880-b1c759c0cc03 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.784997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e91ca-04f5-45f5-8074-532c2d4c3849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.785706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e91ca-04f5-45f5-8074-532c2d4c3849 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.785993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e91ca-04f5-45f5-8074-532c2d4c3849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.786406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e91ca-04f5-45f5-8074-532c2d4c3849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.789259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.790030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.790326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.790721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.791551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.793172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.800031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e91ca-04f5-45f5-8074-532c2d4c3849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.801622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e91ca-04f5-45f5-8074-532c2d4c3849 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:38.810302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1193/2375] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:49:38.811250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:38.814344 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1183/2376] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:49:38.832543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a3ca-57c0-4590-a7e0-71787543214f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:38.839630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:38.840108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:38.840779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:38.841141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] PATH_INFO: `/v3/projects/70baeecd671d42948c5926f11e0d8f5f/users/b302a904f011469686a4eee18f55370b/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:38.863728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70baeecd671d42948c5926f11e0d8f5f, user_id=b302a904f011469686a4eee18f55370b, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:38.867367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:39.325435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1194/2377] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:38 2022] PUT /identity/v3/projects/70baeecd671d42948c5926f11e0d8f5f/users/b302a904f011469686a4eee18f55370b/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:39.336052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:39.338814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:39.338814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:39.378051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] MFA Rules not processed for user `b302a904f011469686a4eee18f55370b`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:39.378051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:39.418936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:39.438809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1184/2378] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:39.449608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:39.451322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:39.509016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8cea-0a67-44d4-b3a4-a30929d85935 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:39.513008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:39.515216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:39.515216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:39.515216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:39.537736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:39.539352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:39.558423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1195/2379] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:39.796158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:39.796158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:39.871883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbfc05-b29c-4755-b530-5e2b147eb4a6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:39.876279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:39.876936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:39.877221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:39.877488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] PATH_INFO: `/v3/projects/a930c9e6e5e74fe4a4b8991b794fd13f` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:39.878604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a930c9e6e5e74fe4a4b8991b794fd13f)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:39.880561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:40.006721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a930c9e6e5e74fe4a4b8991b794fd13f', 'request_id': 'req-450c0fb3-0967-4a0f-9fe3-148def207ad2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.013217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a930c9e6e5e74fe4a4b8991b794fd13f', 'request_id': 'req-450c0fb3-0967-4a0f-9fe3-148def207ad2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.112158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a930c9e6e5e74fe4a4b8991b794fd13f', 'request_id': 'req-450c0fb3-0967-4a0f-9fe3-148def207ad2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.123629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] The token cache is being invalidate because project a930c9e6e5e74fe4a4b8991b794fd13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:40.123899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.124500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.125988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1185/2380] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:39 2022] DELETE /identity/v3/projects/a930c9e6e5e74fe4a4b8991b794fd13f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:40.130097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:40.141170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c113987-7f7e-423e-9ff6-ec375f4c3ea7 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:40.196095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:40.208607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:40.209640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:40.209919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:40.210190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] PATH_INFO: `/v3/users/8083743df83e4aefba8398a77352fb34` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:40.211398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8083743df83e4aefba8398a77352fb34)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:40.214357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:40.441494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8083743df83e4aefba8398a77352fb34'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.442881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8083743df83e4aefba8398a77352fb34'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.459104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8083743df83e4aefba8398a77352fb34'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.557599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8083743df83e4aefba8398a77352fb34'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.573267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8083743df83e4aefba8398a77352fb34'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:40.580256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1196/2381] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:40 2022] DELETE /identity/v3/users/8083743df83e4aefba8398a77352fb34 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:41.120281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:41.122632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:41.156379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0fb3-0967-4a0f-9fe3-148def207ad2 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:41.214913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:41.215647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:41.216023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:41.216400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] PATH_INFO: `/v3/projects/b63fd084267f42cd815382201ce80b8a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:41.217639 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63fd084267f42cd815382201ce80b8a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:41.219839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:41.254319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:41.330532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63fd084267f42cd815382201ce80b8a', 'request_id': 'req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.336842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63fd084267f42cd815382201ce80b8a', 'request_id': 'req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.426071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63fd084267f42cd815382201ce80b8a', 'request_id': 'req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.450737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] The token cache is being invalidate because project b63fd084267f42cd815382201ce80b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:41.451027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.451839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.453338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1186/2382] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:41 2022] DELETE /identity/v3/projects/b63fd084267f42cd815382201ce80b8a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:41.457503 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:41.459522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:41.475029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cc6a1-01e7-484d-868e-474e76f30824 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:41.566786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:41.567583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:41.568539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:41.568539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] PATH_INFO: `/v3/users/f811cb9c4e944569b9beea7ea8ee1cc5` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:41.571547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f811cb9c4e944569b9beea7ea8ee1cc5)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:41.573613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:41.802708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f811cb9c4e944569b9beea7ea8ee1cc5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.803625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f811cb9c4e944569b9beea7ea8ee1cc5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.815896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f811cb9c4e944569b9beea7ea8ee1cc5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.888617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f811cb9c4e944569b9beea7ea8ee1cc5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.898980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:41.905498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0ffbff9a-4671-4e2e-b3bc-70898b0e619f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f811cb9c4e944569b9beea7ea8ee1cc5'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:41.911990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1197/2383] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:41 2022] DELETE /identity/v3/users/f811cb9c4e944569b9beea7ea8ee1cc5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:42.312809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:42.312809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:42.323920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610b37-3c61-4ea9-85db-2635d2e6d6b5 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:42.387946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:42.388613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:42.388895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:42.389195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] PATH_INFO: `/v3/projects/0075d53489a5450cb8bc9178a51379c4` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:42.390333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0075d53489a5450cb8bc9178a51379c4)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:42.392556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:42.536754 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0075d53489a5450cb8bc9178a51379c4', 'request_id': 'req-3642f277-aa7a-4d7f-8925-dd8d29c6557d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:42.545397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0075d53489a5450cb8bc9178a51379c4', 'request_id': 'req-3642f277-aa7a-4d7f-8925-dd8d29c6557d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:42.620188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0075d53489a5450cb8bc9178a51379c4', 'request_id': 'req-3642f277-aa7a-4d7f-8925-dd8d29c6557d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:42.633345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] The token cache is being invalidate because project 0075d53489a5450cb8bc9178a51379c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:42.640188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:42.640188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-3642f277-aa7a-4d7f-8925-dd8d29c6557d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:42.640188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1187/2384] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:42 2022] DELETE /identity/v3/projects/0075d53489a5450cb8bc9178a51379c4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:42.641126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7892-c219-4bd5-8892-06a6b28f1fca None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:42.641629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7892-c219-4bd5-8892-06a6b28f1fca None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:42.641728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7892-c219-4bd5-8892-06a6b28f1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:42.682355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ab6c7892-c219-4bd5-8892-06a6b28f1fca None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:42.682355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ab6c7892-c219-4bd5-8892-06a6b28f1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:42.787201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1198/2385] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:42.795224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051f6b0-e6ce-46c8-9f93-2b0901d224d1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:42.795512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051f6b0-e6ce-46c8-9f93-2b0901d224d1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:42.795857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051f6b0-e6ce-46c8-9f93-2b0901d224d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:42.818551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0051f6b0-e6ce-46c8-9f93-2b0901d224d1 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:42.819832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0051f6b0-e6ce-46c8-9f93-2b0901d224d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:42.828711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1188/2386] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:42.833881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7892-c219-4bd5-8892-06a6b28f1fca None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:42.846871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7892-c219-4bd5-8892-06a6b28f1fca None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:42.853264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:42.855697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:42.855983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:42.856259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:42.857147 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:42.857598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:42.859369 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:42.876678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1199/2387] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:49:42.877842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051f6b0-e6ce-46c8-9f93-2b0901d224d1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:42.902712 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051f6b0-e6ce-46c8-9f93-2b0901d224d1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:42.908127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:42.909616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:42.909896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:42.910168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:42.910811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:42.912805 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:43.027883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:43.028967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1189/2388] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:42 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:49:43.040004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541062a-e5c2-403f-b414-280c5c8609e8 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:43.102682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:43.103546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:43.103976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:43.104570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:43.105418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:43.111856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:43.239190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1200/2389] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:43 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:43.244536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:43.258394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac0fc-1cfc-4d45-a89a-fadccbfb26f3 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:43.264333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:43.265333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:43.265680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:43.266017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:43.267508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:43.269763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:43.272303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:43.282377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1190/2390] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:43.298171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:43.308477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40f4a-379c-43ac-95af-f497096b90bb admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:43.313642 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762172b9-89eb-49f3-a3a6-354b0e999206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:43.314243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762172b9-89eb-49f3-a3a6-354b0e999206 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:43.315046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762172b9-89eb-49f3-a3a6-354b0e999206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:43.315355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762172b9-89eb-49f3-a3a6-354b0e999206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:43.316044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762172b9-89eb-49f3-a3a6-354b0e999206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:43.317686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762172b9-89eb-49f3-a3a6-354b0e999206 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:43.349525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1201/2391] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:43.353658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:43.364596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0fde-e050-40a0-9d53-a47f2f68a858 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:43.371375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:43.377623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:43.377623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:43.377623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] PATH_INFO: `/v3/projects/1c04c8b487224e64bc1208c0da573bf1/users/ae885bfad5a64c7fa73d4585f1eb3d42/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:43.392485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c04c8b487224e64bc1208c0da573bf1, user_id=ae885bfad5a64c7fa73d4585f1eb3d42, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:43.396140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:43.472569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1191/2392] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:43 2022] PUT /identity/v3/projects/1c04c8b487224e64bc1208c0da573bf1/users/ae885bfad5a64c7fa73d4585f1eb3d42/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:43.485353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:43.485809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:43.486036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:43.518237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] MFA Rules not processed for user `ae885bfad5a64c7fa73d4585f1eb3d42`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:43.521088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:43.565848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:43.598693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1202/2393] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:43.606343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:43.608189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:43.697555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7872e2-9eee-4324-8f16-80b3eeeb0475 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:43.701277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c632ef-f76c-46c4-a0da-f1fa68302d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:43.701895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c632ef-f76c-46c4-a0da-f1fa68302d7c service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:43.702169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c632ef-f76c-46c4-a0da-f1fa68302d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:43.702438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c632ef-f76c-46c4-a0da-f1fa68302d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:43.711432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c632ef-f76c-46c4-a0da-f1fa68302d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:43.712850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c632ef-f76c-46c4-a0da-f1fa68302d7c service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:43.722100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1192/2394] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:53.717687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:54.107681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=7 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:54.539691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:54.541113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:54.604116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cab5-1860-4d99-b29d-ee2ae7bd8dbf None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:54.608749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:54.609368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:54.609643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:54.609912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] PATH_INFO: `/v3/users/b302a904f011469686a4eee18f55370b` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:54.611054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b302a904f011469686a4eee18f55370b)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:54.613604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:54.868403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b302a904f011469686a4eee18f55370b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:54.869906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b302a904f011469686a4eee18f55370b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:54.880308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b302a904f011469686a4eee18f55370b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:54.928880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b302a904f011469686a4eee18f55370b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:54.943750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b302a904f011469686a4eee18f55370b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:54.952046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1203/2395] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:49:54 2022] DELETE /identity/v3/users/b302a904f011469686a4eee18f55370b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:54.956097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:54.957333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:54.957614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:54.979432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:54.980674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:55.041529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1193/2396] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:55.051447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:55.053028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:55.118705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc6b54-6385-4147-a977-d56162281f10 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:55.122433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83870272-8c00-4d38-b6f5-40f92b4a1aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:55.123023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870272-8c00-4d38-b6f5-40f92b4a1aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:55.123338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870272-8c00-4d38-b6f5-40f92b4a1aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:55.123690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870272-8c00-4d38-b6f5-40f92b4a1aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:55.140120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870272-8c00-4d38-b6f5-40f92b4a1aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:55.141747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870272-8c00-4d38-b6f5-40f92b4a1aa8 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:55.163730 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1204/2397] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:55.576811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:55.578255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:55.593764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5cd47-ff39-46de-9cba-c5acc3d3f4d4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:55.599137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:55.599891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:55.600198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:55.600536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] PATH_INFO: `/v3/projects/70baeecd671d42948c5926f11e0d8f5f` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:55.601686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70baeecd671d42948c5926f11e0d8f5f)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:55.603659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:55.738427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70baeecd671d42948c5926f11e0d8f5f', 'request_id': 'req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:55.744667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70baeecd671d42948c5926f11e0d8f5f', 'request_id': 'req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:55.821014 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70baeecd671d42948c5926f11e0d8f5f', 'request_id': 'req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:55.833859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] The token cache is being invalidate because project 70baeecd671d42948c5926f11e0d8f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:49:55.834160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:55.834826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a1eb3dde-61d4-4cde-92ed-eb007f2bde82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:49:55.838225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1194/2398] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:49:55 2022] DELETE /identity/v3/projects/70baeecd671d42948c5926f11e0d8f5f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:49:55.842339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7405-cd53-4046-b6f6-65fa8c984895 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:55.842621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7405-cd53-4046-b6f6-65fa8c984895 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:55.842892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7405-cd53-4046-b6f6-65fa8c984895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:55.864286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-9c5c7405-cd53-4046-b6f6-65fa8c984895 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:55.867788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9c5c7405-cd53-4046-b6f6-65fa8c984895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:55.884535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:55.930914 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1205/2399] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:55.939839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777140-1f5a-4247-b1d0-8cc7e788039a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:55.940128 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777140-1f5a-4247-b1d0-8cc7e788039a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:55.940413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777140-1f5a-4247-b1d0-8cc7e788039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:55.962649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0e777140-1f5a-4247-b1d0-8cc7e788039a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:55.964088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0e777140-1f5a-4247-b1d0-8cc7e788039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:55.972931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1195/2400] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:55.980223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c7405-cd53-4046-b6f6-65fa8c984895 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:55.990727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c7405-cd53-4046-b6f6-65fa8c984895 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:55.995418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:55.996096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:55.996377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:55.996652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:55.997306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:49:55.997611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:55.999235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:56.011481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1206/2401] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:49:56.015831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e777140-1f5a-4247-b1d0-8cc7e788039a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:56.025402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e777140-1f5a-4247-b1d0-8cc7e788039a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:56.029990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:56.030566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:56.030841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:56.031109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:56.031768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:56.033683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:56.149442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1196/2402] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:49:56 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:56.153799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:56.164660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095dd5e-bf4e-4600-a214-26ac91e65e71 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:56.224035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:56.224552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:56.224967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:56.225242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:56.225936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:56.227976 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:56.318124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1207/2403] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:49:56 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:49:56.322278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:56.333150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74efbe0-d44e-43b5-a08d-d10edf908cda admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:56.337995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:56.338581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:56.338857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:56.339193 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:56.340223 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:56.341582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:56.352357 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1197/2404] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:56.356272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:56.366163 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96be062-c231-4555-9f4c-4e918f029c19 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:56.370820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94f0e9-4243-4afc-9deb-0deefd220fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:56.371442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f0e9-4243-4afc-9deb-0deefd220fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:56.379891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f0e9-4243-4afc-9deb-0deefd220fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:56.379891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94f0e9-4243-4afc-9deb-0deefd220fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:56.379891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94f0e9-4243-4afc-9deb-0deefd220fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:56.379891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94f0e9-4243-4afc-9deb-0deefd220fc5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:56.385741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1208/2405] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:49:56.389803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:56.400261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d9eb-dc34-401b-b79d-63b8b615242e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:56.404925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:56.408607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:56.408607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:56.408607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] PATH_INFO: `/v3/projects/06739a45eac948d2b8d061b2bbe7c85d/users/406787ab06f244689131fb0e6ab05f7c/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:56.421204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06739a45eac948d2b8d061b2bbe7c85d, user_id=406787ab06f244689131fb0e6ab05f7c, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:56.423934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:56.484819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1198/2406] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:49:56 2022] PUT /identity/v3/projects/06739a45eac948d2b8d061b2bbe7c85d/users/406787ab06f244689131fb0e6ab05f7c/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:49:56.495222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4c180-f696-4cd7-a408-d26ecc90c139 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:56.495517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4c180-f696-4cd7-a408-d26ecc90c139 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:56.495795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4c180-f696-4cd7-a408-d26ecc90c139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:56.524942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-95b4c180-f696-4cd7-a408-d26ecc90c139 None None] MFA Rules not processed for user `406787ab06f244689131fb0e6ab05f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:56.529230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-95b4c180-f696-4cd7-a408-d26ecc90c139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:56.598209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1209/2407] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:49:56.608902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:56.610632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:56.633687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:56.670790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ef7c-a22f-4005-9b98-2ad0831ba0a8 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:56.675561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:56.676236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:56.676586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:56.676927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:56.685933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:56.687399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:56.696981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1199/2408] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:59.534131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:59.535723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:59.535723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:59.556084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] MFA Rules not processed for user `406787ab06f244689131fb0e6ab05f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:49:59.557293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:59.565803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1210/2409] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:06.860610 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=17 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:09.548819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:16.556654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:16.558064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:16.618213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67005e8-5fe4-4baa-9558-b7525d8145dd service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:16.621798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d82f6-6624-4c47-8ec2-36cf7bcb38e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:16.622400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d82f6-6624-4c47-8ec2-36cf7bcb38e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:16.622679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d82f6-6624-4c47-8ec2-36cf7bcb38e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:16.622948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d82f6-6624-4c47-8ec2-36cf7bcb38e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:16.624733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-007d82f6-6624-4c47-8ec2-36cf7bcb38e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:16.696720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d82f6-6624-4c47-8ec2-36cf7bcb38e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:16.698166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d82f6-6624-4c47-8ec2-36cf7bcb38e2 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:16.707779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1200/2410] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:23.490496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:23.499348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:23.560747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b7197-8eed-42d9-8d5e-35d3042fb868 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:23.565839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:23.566439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:23.566718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:23.566990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:23.569431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:23.580773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:23.582409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:23.592816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1211/2411] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:25.659561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e28e-52ee-4e01-a4ef-f14203fe955d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:25.660065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e28e-52ee-4e01-a4ef-f14203fe955d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:25.660160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e28e-52ee-4e01-a4ef-f14203fe955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:25.680206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6a69e28e-52ee-4e01-a4ef-f14203fe955d None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:25.681394 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6a69e28e-52ee-4e01-a4ef-f14203fe955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:25.736994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1201/2412] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:25.758912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:25.760337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:25.827287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465388d-2ff0-484c-bb6b-b06881a17f3a service placement] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:25.832259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:25.833393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:25.833673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:25.833939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:25.841854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:25.843461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:25.851926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1212/2413] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:50:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:50:26.716650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ca913-7ecd-40c5-8652-bb652c580388 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:26.717892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ca913-7ecd-40c5-8652-bb652c580388 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:26.717892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ca913-7ecd-40c5-8652-bb652c580388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:26.740340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-411ca913-7ecd-40c5-8652-bb652c580388 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:26.741582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-411ca913-7ecd-40c5-8652-bb652c580388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:26.749946 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1202/2414] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 1 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:26.764237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:26.777522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75380-781f-426b-b706-331b8bdc8b29 service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:26.782887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:26.792659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:26.792659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:26.792659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:26.794581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:26.796260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:26.805469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1213/2415] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:50:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:50:27.474801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bdddf-4fa7-4cdc-a74a-aff484a1dfb4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:27.475102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bdddf-4fa7-4cdc-a74a-aff484a1dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:27.475532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bdddf-4fa7-4cdc-a74a-aff484a1dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:27.496300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-810bdddf-4fa7-4cdc-a74a-aff484a1dfb4 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:27.497524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-810bdddf-4fa7-4cdc-a74a-aff484a1dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:27.504929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1203/2416] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:50:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:27.516933 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:27.528121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24992737-2264-45d4-bfa0-5c5339bc334c service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:27.533282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:27.533875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:27.534155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:27.534428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:27.543575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:27.545197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:27.554006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1214/2417] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:50:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:50:28.298002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158e55-f3e9-43eb-99d8-7fa66360cf18 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:28.298453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158e55-f3e9-43eb-99d8-7fa66360cf18 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:28.298558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158e55-f3e9-43eb-99d8-7fa66360cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:28.318002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6b158e55-f3e9-43eb-99d8-7fa66360cf18 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:28.319269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6b158e55-f3e9-43eb-99d8-7fa66360cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:28.326308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1204/2418] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 1 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:28.338936 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:28.350457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126cb5f-7c32-49e5-a99e-5c2b5edceced service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:28.355480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb365c-7cf4-4bbe-bede-0f81038f2833 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:28.356066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb365c-7cf4-4bbe-bede-0f81038f2833 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:28.356339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb365c-7cf4-4bbe-bede-0f81038f2833 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:28.356606 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb365c-7cf4-4bbe-bede-0f81038f2833 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:28.364809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb365c-7cf4-4bbe-bede-0f81038f2833 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:28.366365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb365c-7cf4-4bbe-bede-0f81038f2833 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:28.374619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1215/2419] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:50:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:50:31.155396 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158e55-f3e9-43eb-99d8-7fa66360cf18 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:31.193491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:31.218195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158e55-f3e9-43eb-99d8-7fa66360cf18 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:31.222740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:31.223393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:31.223667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:31.223934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] PATH_INFO: `/v3/users/406787ab06f244689131fb0e6ab05f7c` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:31.225600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406787ab06f244689131fb0e6ab05f7c)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:31.227906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:31.463909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406787ab06f244689131fb0e6ab05f7c'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:31.475559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406787ab06f244689131fb0e6ab05f7c'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:31.483606 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406787ab06f244689131fb0e6ab05f7c'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:31.484273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406787ab06f244689131fb0e6ab05f7c'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:31.484880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406787ab06f244689131fb0e6ab05f7c'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:31.535144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1205/2420] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:50:31 2022] DELETE /identity/v3/users/406787ab06f244689131fb0e6ab05f7c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:31.539891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:31.540382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:31.540632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:31.561382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:31.562832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:31.598098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:31.624162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1216/2421] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:50:31.634927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:31.636461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:31.701067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c089edd-b70d-4337-a655-17df1bd2cc24 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:31.704630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:31.705218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:31.705497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:31.705768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:31.715365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:31.716901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:31.726182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1206/2422] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:31.983048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:31.984486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:31.996739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc29065-7370-48bd-924f-f1dc2a000f58 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:32.001558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:32.002219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:32.002498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:32.002771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] PATH_INFO: `/v3/projects/06739a45eac948d2b8d061b2bbe7c85d` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:32.004332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06739a45eac948d2b8d061b2bbe7c85d)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:32.006770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:32.159748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06739a45eac948d2b8d061b2bbe7c85d', 'request_id': 'req-95690498-d842-4522-9ae3-61d9bd2d9f83'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:32.165887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06739a45eac948d2b8d061b2bbe7c85d', 'request_id': 'req-95690498-d842-4522-9ae3-61d9bd2d9f83'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:32.255397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06739a45eac948d2b8d061b2bbe7c85d', 'request_id': 'req-95690498-d842-4522-9ae3-61d9bd2d9f83'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:32.267207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] The token cache is being invalidate because project 06739a45eac948d2b8d061b2bbe7c85d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:50:32.267492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:32.268128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-95690498-d842-4522-9ae3-61d9bd2d9f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:32.269614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1217/2423] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:50:31 2022] DELETE /identity/v3/projects/06739a45eac948d2b8d061b2bbe7c85d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:36.862124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:36.863554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:36.875974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1128dd-6cb8-4e35-bcb2-0b9a42196078 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:36.926656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:36.932415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:36.933034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:36.933315 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:36.933593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] PATH_INFO: `/v3/users/ae885bfad5a64c7fa73d4585f1eb3d42` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:36.934709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae885bfad5a64c7fa73d4585f1eb3d42)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:36.936663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:37.101596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae885bfad5a64c7fa73d4585f1eb3d42'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:37.117792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae885bfad5a64c7fa73d4585f1eb3d42'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:37.125571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae885bfad5a64c7fa73d4585f1eb3d42'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:37.126368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae885bfad5a64c7fa73d4585f1eb3d42'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:37.126937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae885bfad5a64c7fa73d4585f1eb3d42'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:37.188032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1207/2424] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:50:36 2022] DELETE /identity/v3/users/ae885bfad5a64c7fa73d4585f1eb3d42 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:37.193033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:37.193907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:37.194376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:37.214784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:37.216231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:37.275391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1218/2425] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:37.285055 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:37.286501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:37.343301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36efdd-7a86-4a46-bcff-31f16b1e0961 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:37.346859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf0c67-88a7-4b9d-8d9b-2ff938279239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:37.347481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0c67-88a7-4b9d-8d9b-2ff938279239 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:37.347758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0c67-88a7-4b9d-8d9b-2ff938279239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:37.348029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0c67-88a7-4b9d-8d9b-2ff938279239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:37.357437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf0c67-88a7-4b9d-8d9b-2ff938279239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:37.358843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf0c67-88a7-4b9d-8d9b-2ff938279239 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:37.368183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1208/2426] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:50:37.832973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:37.834556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:37.857791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe5abc-6d39-4bf9-8c17-7518d883355e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:37.866311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:37.867634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:37.868246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:37.868674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] PATH_INFO: `/v3/projects/1c04c8b487224e64bc1208c0da573bf1` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:37.870262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c04c8b487224e64bc1208c0da573bf1)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:37.872521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:37.970417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c04c8b487224e64bc1208c0da573bf1', 'request_id': 'req-63e79ee1-978e-46b0-83b6-eef6edb4b963'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:37.975990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c04c8b487224e64bc1208c0da573bf1', 'request_id': 'req-63e79ee1-978e-46b0-83b6-eef6edb4b963'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:37.978203 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:38.043528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c04c8b487224e64bc1208c0da573bf1', 'request_id': 'req-63e79ee1-978e-46b0-83b6-eef6edb4b963'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:38.054771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] The token cache is being invalidate because project 1c04c8b487224e64bc1208c0da573bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:50:38.055050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:38.055694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-63e79ee1-978e-46b0-83b6-eef6edb4b963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:50:38.057165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1219/2427] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:50:37 2022] DELETE /identity/v3/projects/1c04c8b487224e64bc1208c0da573bf1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:50:44.611750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:44.612289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:44.612289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:44.631596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] MFA Rules not processed for user `a9ec9d7971ad4bd5a176bf95e7a2b135`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:44.632834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:44.695790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1209/2428] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:48.100884 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:54.689025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:57.020540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8103b5d-7f90-4a29-8215-f7ca4f0560af None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:57.021035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8103b5d-7f90-4a29-8215-f7ca4f0560af None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:57.021035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8103b5d-7f90-4a29-8215-f7ca4f0560af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:57.051554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b8103b5d-7f90-4a29-8215-f7ca4f0560af None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:50:57.051554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b8103b5d-7f90-4a29-8215-f7ca4f0560af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:57.101306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1220/2429] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:50:57.113816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:50:57.115291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:50:57.187020 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f7ca9-d5a8-408f-ad27-acc93f574fe0 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:50:57.191971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1774bb-7730-410e-ae13-2eb3b3af5e0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:50:57.192575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1774bb-7730-410e-ae13-2eb3b3af5e0d service swift] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:50:57.192857 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1774bb-7730-410e-ae13-2eb3b3af5e0d service swift] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:50:57.193131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1774bb-7730-410e-ae13-2eb3b3af5e0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:50:57.204773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1774bb-7730-410e-ae13-2eb3b3af5e0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:50:57.206385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1774bb-7730-410e-ae13-2eb3b3af5e0d service swift] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:50:57.215277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1210/2430] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:50:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:51:07.094694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=25 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:07.211739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=32 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:17.744588 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c404-402a-4731-a128-1215cd405711 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:17.745240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c404-402a-4731-a128-1215cd405711 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:17.745240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c404-402a-4731-a128-1215cd405711 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:17.747100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1221/2431] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:51:17.753026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc998cd-a85c-4d82-b816-c14e1452a9f2 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:17.753963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc998cd-a85c-4d82-b816-c14e1452a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:17.753963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc998cd-a85c-4d82-b816-c14e1452a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:17.773771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5dc998cd-a85c-4d82-b816-c14e1452a9f2 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:51:17.774998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5dc998cd-a85c-4d82-b816-c14e1452a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:17.844850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1211/2432] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:51:17.856494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c404-402a-4731-a128-1215cd405711 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:17.858146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e9e7c404-402a-4731-a128-1215cd405711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:17.916400 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c404-402a-4731-a128-1215cd405711 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:17.920825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5856a-1a54-4bf9-a449-f98d1e375448 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:17.921426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5856a-1a54-4bf9-a449-f98d1e375448 service glance] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:17.921706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5856a-1a54-4bf9-a449-f98d1e375448 service glance] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:17.921975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5856a-1a54-4bf9-a449-f98d1e375448 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:17.931872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5856a-1a54-4bf9-a449-f98d1e375448 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:17.933912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5856a-1a54-4bf9-a449-f98d1e375448 service glance] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:17.944241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1222/2433] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:51:18.120922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e343906-f61c-4767-96c2-637791f4a2b4 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:18.121149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e343906-f61c-4767-96c2-637791f4a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:18.121423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e343906-f61c-4767-96c2-637791f4a2b4 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:18.122764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1212/2434] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:51:18.127465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f173e-6fc0-479d-a0df-9c0d32301200 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:18.131134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f173e-6fc0-479d-a0df-9c0d32301200 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:18.131134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f173e-6fc0-479d-a0df-9c0d32301200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:18.149076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d12f173e-6fc0-479d-a0df-9c0d32301200 None None] MFA Rules not processed for user `94c7e57c93dd49a1a3e784002ae94fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:51:18.150287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d12f173e-6fc0-479d-a0df-9c0d32301200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:18.200548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1223/2435] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:51:18.212252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e343906-f61c-4767-96c2-637791f4a2b4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:18.214516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4e343906-f61c-4767-96c2-637791f4a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:18.227609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e343906-f61c-4767-96c2-637791f4a2b4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:18.231839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c09042-6acc-4503-ac0c-be90d805a3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:18.232452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09042-6acc-4503-ac0c-be90d805a3af service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:18.232723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09042-6acc-4503-ac0c-be90d805a3af service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:18.232987 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09042-6acc-4503-ac0c-be90d805a3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:18.239926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c09042-6acc-4503-ac0c-be90d805a3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:18.241331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c09042-6acc-4503-ac0c-be90d805a3af service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:18.248886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1213/2436] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:51:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:51:18.332608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d74b-678a-4877-bba4-06cf4e45d6f3 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:18.332897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d74b-678a-4877-bba4-06cf4e45d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:18.333196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d74b-678a-4877-bba4-06cf4e45d6f3 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:18.334596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1224/2437] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:51:18.339902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b973-a8c7-4a3d-9d7c-1fc35378c693 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:18.340216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b973-a8c7-4a3d-9d7c-1fc35378c693 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:18.340487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b973-a8c7-4a3d-9d7c-1fc35378c693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:18.360512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8300b973-a8c7-4a3d-9d7c-1fc35378c693 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:51:18.361688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8300b973-a8c7-4a3d-9d7c-1fc35378c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:18.370688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1214/2438] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:51:18.380689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059d74b-678a-4877-bba4-06cf4e45d6f3 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:18.397107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059d74b-678a-4877-bba4-06cf4e45d6f3 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:18.400679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:18.401781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:18.402054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:18.402323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:18.412319 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:18.413734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:18.424738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1225/2439] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:51:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:51:22.501594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9cf7-7450-4afe-8610-26f1302b01cc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:22.502045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9cf7-7450-4afe-8610-26f1302b01cc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:22.502207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9cf7-7450-4afe-8610-26f1302b01cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:22.522243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ce4e9cf7-7450-4afe-8610-26f1302b01cc None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:51:22.523500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ce4e9cf7-7450-4afe-8610-26f1302b01cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:22.530881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1215/2440] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:51:22.543250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:22.554245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c91df-1467-48e2-800a-630d256a215e service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:22.559704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:22.560294 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:22.560634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:22.560911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:22.568722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:22.570279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:22.578228 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1226/2441] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:51:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:51:32.517155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=43 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:32.575002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=61 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:51.856979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31e0b3-297c-4a0c-b7fa-796ec6789901 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:51.856979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31e0b3-297c-4a0c-b7fa-796ec6789901 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:51.856979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31e0b3-297c-4a0c-b7fa-796ec6789901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:51.876320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0a31e0b3-297c-4a0c-b7fa-796ec6789901 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:51:51.877527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0a31e0b3-297c-4a0c-b7fa-796ec6789901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:51:51.885027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1216/2442] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 1 16:51:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:51:51.908338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:51:51.918716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf77ce-e338-4775-a25a-92fb30d1ad74 service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:51:51.924302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:51:51.924896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:51:51.925172 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:51:51.925442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:51:51.933720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:51:51.935937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:51:51.944218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1227/2443] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:51:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:52:01.870291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:52:01.940789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:52:17.260991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31e0b3-297c-4a0c-b7fa-796ec6789901 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:52:17.270680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31e0b3-297c-4a0c-b7fa-796ec6789901 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:52:17.274376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:52:17.274968 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:52:17.275282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:52:17.275559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:52:17.277323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:52:17.290472 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:52:17.291951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:52:17.303424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1217/2444] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:52:18.528648 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:52:18.530095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:52:18.542341 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf83bc-a811-4acf-8eb5-35dc9015f4a6 service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:52:18.545866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:52:18.546449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:52:18.546727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:52:18.546992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:52:18.549279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:52:18.561894 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:52:18.563322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:52:18.573998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1228/2445] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:52:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:52:27.298507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=6 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:52:28.172168 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:52:28.173738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:52:28.187647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cbd3d-312e-4eea-aa85-88b6301b9c4d service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:52:28.193758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:52:28.194346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:52:28.194621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:52:28.194888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:52:28.196622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:52:28.257734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:52:28.259356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:52:28.269355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1218/2446] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:52:28.569266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:52:38.264477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=28 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:52:45.217818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:52:45.227056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617abc9-7906-4d5d-be3e-fa52bcc0e2b4 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:52:45.230704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:52:45.231326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:52:45.231607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:52:45.231878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:52:45.233599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:52:45.243652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:52:45.245064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:52:45.252953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1229/2447] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:52:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:52:55.249342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:11.944019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:53:11.945354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:11.960117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0bfba-999a-4489-9c7e-0307469fcbe9 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:53:11.965548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9a2c-999c-4177-a8b1-7712bb9f4f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:53:11.966160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9a2c-999c-4177-a8b1-7712bb9f4f20 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:11.966441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9a2c-999c-4177-a8b1-7712bb9f4f20 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:11.966715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9a2c-999c-4177-a8b1-7712bb9f4f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:11.968380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f4ab9a2c-999c-4177-a8b1-7712bb9f4f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:12.025636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab9a2c-999c-4177-a8b1-7712bb9f4f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:53:12.027246 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab9a2c-999c-4177-a8b1-7712bb9f4f20 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:53:12.036704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1219/2448] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:53:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:53:19.073555 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:53:19.087797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf39272-1f35-4b9f-bf96-c4afbdee9ae4 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:53:19.093912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326bd43-78c4-4407-81e5-f16164aa2537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:53:19.094601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326bd43-78c4-4407-81e5-f16164aa2537 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:19.094951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326bd43-78c4-4407-81e5-f16164aa2537 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:19.095340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326bd43-78c4-4407-81e5-f16164aa2537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:19.097098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d326bd43-78c4-4407-81e5-f16164aa2537 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:19.111456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326bd43-78c4-4407-81e5-f16164aa2537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:53:19.113171 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326bd43-78c4-4407-81e5-f16164aa2537 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:53:19.124445 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1230/2449] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:53:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:53:22.032006 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=28 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:25.767686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ececc-e65c-47b5-bfdc-d72a4bf075a6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:25.768284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ececc-e65c-47b5-bfdc-d72a4bf075a6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:25.768284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ececc-e65c-47b5-bfdc-d72a4bf075a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:25.791182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0e7ececc-e65c-47b5-bfdc-d72a4bf075a6 None None] MFA Rules not processed for user `a9ec9d7971ad4bd5a176bf95e7a2b135`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:53:25.792432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0e7ececc-e65c-47b5-bfdc-d72a4bf075a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:25.804477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1220/2450] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:53:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:53:26.416129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:26.416638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:26.416729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:26.435696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] MFA Rules not processed for user `1500bceab76f41c5b3e69e1cf55117aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:53:26.436898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:26.444428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1231/2451] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:53:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:53:26.940361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ececc-e65c-47b5-bfdc-d72a4bf075a6 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:53:26.950381 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ececc-e65c-47b5-bfdc-d72a4bf075a6 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:53:26.953947 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:53:26.954547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:26.954867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:26.955119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:26.956829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:26.969471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:53:26.970910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:53:26.980435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1221/2452] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:53:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:53:27.371928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:53:27.373333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:27.458850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec243b-7918-436d-b636-7fe534c0a9af None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:53:27.464782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:53:27.465397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:27.465674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:27.465945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:27.467906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:27.480692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:53:27.482281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:53:27.492677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1232/2453] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:53:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:53:32.510005 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:53:32.535132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3074f24-dc8d-4ba3-a601-61ef53f87b05 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:53:32.547694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59232ff-2c67-4131-895d-d537f61de718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:53:32.548415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59232ff-2c67-4131-895d-d537f61de718 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:32.548752 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59232ff-2c67-4131-895d-d537f61de718 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:32.549093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59232ff-2c67-4131-895d-d537f61de718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:32.551110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c59232ff-2c67-4131-895d-d537f61de718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:32.565016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59232ff-2c67-4131-895d-d537f61de718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:53:32.566739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59232ff-2c67-4131-895d-d537f61de718 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:53:32.578391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1222/2454] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:53:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:53:37.488077 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=41 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:41.279870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:53:41.294196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a6d6-f247-4a5d-b299-b4c1dccc6097 service placement] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:53:41.299862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:53:41.300794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:53:41.301075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:53:41.301352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:53:41.304038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:53:41.317197 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:53:41.318888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:53:41.330059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1233/2455] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:53:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:53:42.573473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=15 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:51.325412 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:05.367704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7a791-b3ae-4d90-abe2-af26e396977c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:05.368211 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7a791-b3ae-4d90-abe2-af26e396977c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:05.368427 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7a791-b3ae-4d90-abe2-af26e396977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:05.389799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a8c7a791-b3ae-4d90-abe2-af26e396977c None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:54:05.391739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a8c7a791-b3ae-4d90-abe2-af26e396977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:05.399716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1223/2456] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 1 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:54:05.501942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:05.513607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef29cb-ec68-4c3a-b46b-2ae9e14d4d17 service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:05.518984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:05.519640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:05.519919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:05.520190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:05.529029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:05.530655 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:05.538832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1234/2457] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:54:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:54:06.404591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7a791-b3ae-4d90-abe2-af26e396977c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:06.413860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7a791-b3ae-4d90-abe2-af26e396977c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:06.417449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04c7e2-9d0b-45bf-8c94-86dfd82ac0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:06.418037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04c7e2-9d0b-45bf-8c94-86dfd82ac0ba service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:06.418309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04c7e2-9d0b-45bf-8c94-86dfd82ac0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:06.418572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04c7e2-9d0b-45bf-8c94-86dfd82ac0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:06.420300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8a04c7e2-9d0b-45bf-8c94-86dfd82ac0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:06.480516 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04c7e2-9d0b-45bf-8c94-86dfd82ac0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:06.481861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04c7e2-9d0b-45bf-8c94-86dfd82ac0ba service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:06.491104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1224/2458] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:54:11.051952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:11.063456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e33a6d-612d-4920-8df4-2e27a2e8a0e4 service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:11.068509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:11.086551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:11.086551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:11.086551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:11.086551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:11.086551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:11.087047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:11.095455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1235/2459] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:54:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:54:14.108432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f560978-45ee-4bee-88ff-5d87310c59cc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:14.109543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f560978-45ee-4bee-88ff-5d87310c59cc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:14.110099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f560978-45ee-4bee-88ff-5d87310c59cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:14.131745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4f560978-45ee-4bee-88ff-5d87310c59cc None None] MFA Rules not processed for user `90c1309ba78a46f0b3a4cd67c4c89542`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:54:14.133075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4f560978-45ee-4bee-88ff-5d87310c59cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:14.141899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1225/2460] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:54:14.466400 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:14.477762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618829-491b-4d7a-bc55-5a032f5544e3 service placement] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:14.482076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:14.482707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:14.482987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:14.483339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:14.485175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:14.496351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:14.497702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:14.508374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1236/2461] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:54:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:54:15.030885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f560978-45ee-4bee-88ff-5d87310c59cc None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:15.043034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f560978-45ee-4bee-88ff-5d87310c59cc None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:15.048548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:15.049156 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:15.049436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:15.049705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:15.051555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:15.065926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:15.065926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:15.076707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1226/2462] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:54:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:54:15.175187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:15.176634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:15.194155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357a26-c3db-4d14-8a67-08735233706f service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:15.198767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:15.199404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:15.199690 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:15.199961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] PATH_INFO: `/v3/users/86064d641dc34603a4b7436ae6219755` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:15.201102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=86064d641dc34603a4b7436ae6219755)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:15.203016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:15.390737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86064d641dc34603a4b7436ae6219755'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:15.391426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86064d641dc34603a4b7436ae6219755'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:15.399007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86064d641dc34603a4b7436ae6219755'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:15.497543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86064d641dc34603a4b7436ae6219755'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:15.513802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86064d641dc34603a4b7436ae6219755'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:15.520205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1237/2463] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:54:15 2022] DELETE /identity/v3/users/86064d641dc34603a4b7436ae6219755 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:54:15.745555 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:15.766249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb96be8-cac2-444f-bbfe-6f313110cd27 service placement] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:15.836138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:15.836782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:15.837060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:15.837333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] PATH_INFO: `/v3/projects/f4a65f5263734e75a8932995baa8ab5f` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:15.838457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a65f5263734e75a8932995baa8ab5f)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:15.840398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:15.979594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a65f5263734e75a8932995baa8ab5f', 'request_id': 'req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:15.986755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a65f5263734e75a8932995baa8ab5f', 'request_id': 'req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.051708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a65f5263734e75a8932995baa8ab5f', 'request_id': 'req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.059445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:16.065741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] The token cache is being invalidate because project f4a65f5263734e75a8932995baa8ab5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:54:16.065741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.065741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.067449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1227/2464] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:54:15 2022] DELETE /identity/v3/projects/f4a65f5263734e75a8932995baa8ab5f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:54:16.071545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:16.073878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:16.090137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d33bd-6dde-4bf3-b558-ef2e2044c8bd admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:16.149160 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:16.149797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:16.150079 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:16.150354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] PATH_INFO: `/v3/users/46eb2787a3fd4dccba0dc1c372ee9c29` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:16.151523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46eb2787a3fd4dccba0dc1c372ee9c29)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:16.153476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:16.381552 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:16.390990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46eb2787a3fd4dccba0dc1c372ee9c29'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.391683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46eb2787a3fd4dccba0dc1c372ee9c29'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.399226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46eb2787a3fd4dccba0dc1c372ee9c29'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.468567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46eb2787a3fd4dccba0dc1c372ee9c29'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.482642 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46eb2787a3fd4dccba0dc1c372ee9c29'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:16.489099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1238/2465] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:54:16 2022] DELETE /identity/v3/users/46eb2787a3fd4dccba0dc1c372ee9c29 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:54:16.745506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:16.747377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:16.762362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c86d54-e434-4a1d-a7c6-daf503e9dff6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:16.825826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:16.826461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:16.826756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:16.827028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] PATH_INFO: `/v3/projects/6719850efb1a4310b29eff781f0c008d` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:16.828221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6719850efb1a4310b29eff781f0c008d)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:16.830121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:17.051198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6719850efb1a4310b29eff781f0c008d', 'request_id': 'req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:17.058165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6719850efb1a4310b29eff781f0c008d', 'request_id': 'req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:17.171769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6719850efb1a4310b29eff781f0c008d', 'request_id': 'req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:17.183402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] The token cache is being invalidate because project 6719850efb1a4310b29eff781f0c008d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:54:17.183710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:17.184329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:54:17.185833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1228/2466] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:54:16 2022] DELETE /identity/v3/projects/6719850efb1a4310b29eff781f0c008d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:54:26.606116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:27.179716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:51.639543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:54:51.641331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:51.698033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187e181-3b57-4aae-8d34-bf5563835135 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:54:51.747207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:54:51.747814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:54:51.748090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:54:51.748358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:54:51.750110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:54:51.807570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:54:51.809000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:54:51.817930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1239/2467] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:54:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:01.813812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=68 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:14.965001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:14.966402 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:15.053464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fc359-5f8e-4f5c-b5d2-e4d33fcfb389 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:15.057226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:15.061920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:15.061920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:15.061920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:15.061920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:15.162547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:15.164021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:15.183089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1229/2468] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:18.791734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:18.793276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:18.833927 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcede2-eccf-4851-b6b2-ba28805ce128 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:18.838507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:18.839125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:18.839431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:18.839701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] PATH_INFO: `/v3/users/a9ec9d7971ad4bd5a176bf95e7a2b135` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:18.840810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ec9d7971ad4bd5a176bf95e7a2b135)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:18.842720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:19.025621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ec9d7971ad4bd5a176bf95e7a2b135'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.026292 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ec9d7971ad4bd5a176bf95e7a2b135'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.033398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ec9d7971ad4bd5a176bf95e7a2b135'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.080639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ec9d7971ad4bd5a176bf95e7a2b135'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.092651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3da73a66-a57f-48d1-aca5-3bb3c8af843e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ec9d7971ad4bd5a176bf95e7a2b135'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.098424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1240/2469] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:55:18 2022] DELETE /identity/v3/users/a9ec9d7971ad4bd5a176bf95e7a2b135 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:19.344054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:19.355618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2595d1-5f2a-4d1f-ad6c-d8c341757454 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:19.387017 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:19.413378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:19.414258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:19.414539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:19.414812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] PATH_INFO: `/v3/projects/f7b1385143d5408ca425f507de5fdf76` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:19.416541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b1385143d5408ca425f507de5fdf76)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:19.419426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:19.525732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b1385143d5408ca425f507de5fdf76', 'request_id': 'req-09d79465-c3e8-472b-8b8c-c9844b26f907'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.531965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b1385143d5408ca425f507de5fdf76', 'request_id': 'req-09d79465-c3e8-472b-8b8c-c9844b26f907'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.605751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b1385143d5408ca425f507de5fdf76', 'request_id': 'req-09d79465-c3e8-472b-8b8c-c9844b26f907'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.617049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] The token cache is being invalidate because project f7b1385143d5408ca425f507de5fdf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:55:19.617353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.617966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-09d79465-c3e8-472b-8b8c-c9844b26f907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:19.619511 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1230/2470] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:55:19 2022] DELETE /identity/v3/projects/f7b1385143d5408ca425f507de5fdf76 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:19.625468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900d40-b8d6-404c-9cc1-c65d28e6fa0e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:19.625794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900d40-b8d6-404c-9cc1-c65d28e6fa0e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:19.627615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900d40-b8d6-404c-9cc1-c65d28e6fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:19.685405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-55900d40-b8d6-404c-9cc1-c65d28e6fa0e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:19.686583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-55900d40-b8d6-404c-9cc1-c65d28e6fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:19.745997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1241/2471] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:55:19.755218 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38234-3db2-4a4c-abc3-ec5bd3266fd5 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:19.755508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38234-3db2-4a4c-abc3-ec5bd3266fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:19.755814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38234-3db2-4a4c-abc3-ec5bd3266fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:19.776479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-15f38234-3db2-4a4c-abc3-ec5bd3266fd5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:19.777819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-15f38234-3db2-4a4c-abc3-ec5bd3266fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:19.787803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1231/2472] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:19.792215 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55900d40-b8d6-404c-9cc1-c65d28e6fa0e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:19.802031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55900d40-b8d6-404c-9cc1-c65d28e6fa0e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:19.806705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:19.807328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:19.807660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:19.807932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:19.808607 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:55:19.808903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:19.810609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:19.822828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1242/2473] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:55:19.827209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f38234-3db2-4a4c-abc3-ec5bd3266fd5 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:19.838613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f38234-3db2-4a4c-abc3-ec5bd3266fd5 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:19.843283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:19.843872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:19.844164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:19.844517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:19.845182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:19.847071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:19.909644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1232/2474] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:19 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:19.913768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:19.918915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:19.924283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47235763-b033-4b63-8133-e3c6921888c7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:19.979876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:19.980472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:19.980747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:19.981015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:19.981645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:19.983636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:20.109052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1243/2475] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:19 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:20.113641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:20.123705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7555a1-83f5-4228-b4df-8be6328da189 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:20.129361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:20.129952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:20.130226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:20.130495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:20.131135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:20.132836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:20.143098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1233/2476] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:20.147225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:20.157478 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a60ae-d8a1-4eb5-ad6a-f00f40e96b91 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:20.162188 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464cc8-bdd2-4510-bb60-9b0e0bee5471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:20.162718 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464cc8-bdd2-4510-bb60-9b0e0bee5471 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:20.162996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464cc8-bdd2-4510-bb60-9b0e0bee5471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:20.163300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464cc8-bdd2-4510-bb60-9b0e0bee5471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:20.163937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464cc8-bdd2-4510-bb60-9b0e0bee5471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:20.165646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464cc8-bdd2-4510-bb60-9b0e0bee5471 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:20.177694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1244/2477] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:20.181696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:20.192355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05466-b448-4dde-a3ee-c368c26e0bde admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:20.196912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:20.197558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:20.197836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:20.198105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] PATH_INFO: `/v3/projects/6977baf36979451b91b47c04ba2db2b3/users/91d2079ce2a142a4b97fc4adc25a40e0/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:20.212383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6977baf36979451b91b47c04ba2db2b3, user_id=91d2079ce2a142a4b97fc4adc25a40e0, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:20.215019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:20.303608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1234/2478] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:20 2022] PUT /identity/v3/projects/6977baf36979451b91b47c04ba2db2b3/users/91d2079ce2a142a4b97fc4adc25a40e0/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:20.314001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160ffe-bef1-42e9-9b17-35ce623a960c None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:20.314903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160ffe-bef1-42e9-9b17-35ce623a960c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:20.315322 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160ffe-bef1-42e9-9b17-35ce623a960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:20.342640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1e160ffe-bef1-42e9-9b17-35ce623a960c None None] MFA Rules not processed for user `91d2079ce2a142a4b97fc4adc25a40e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:20.343939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1e160ffe-bef1-42e9-9b17-35ce623a960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:20.409849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1245/2479] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:55:20.421062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:20.422684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:20.488899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:20.527413 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded9cb-fd66-4a3b-a4a9-6f61559093ba admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:20.533514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2732a85-d8fc-4ee0-b83b-84319434a280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:20.534103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2732a85-d8fc-4ee0-b83b-84319434a280 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:20.534379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2732a85-d8fc-4ee0-b83b-84319434a280 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:20.534646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2732a85-d8fc-4ee0-b83b-84319434a280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:20.542868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2732a85-d8fc-4ee0-b83b-84319434a280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:20.544579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2732a85-d8fc-4ee0-b83b-84319434a280 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:20.553846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1235/2480] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:23.633142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160ffe-bef1-42e9-9b17-35ce623a960c None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:23.694644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160ffe-bef1-42e9-9b17-35ce623a960c None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:23.699213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:23.699837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:23.700117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:23.700390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] PATH_INFO: `/v3/users/91d2079ce2a142a4b97fc4adc25a40e0` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:23.701506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d2079ce2a142a4b97fc4adc25a40e0)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:23.703499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:23.715844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:23.906625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d2079ce2a142a4b97fc4adc25a40e0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:23.907315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d2079ce2a142a4b97fc4adc25a40e0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:23.915146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d2079ce2a142a4b97fc4adc25a40e0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:23.966095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d2079ce2a142a4b97fc4adc25a40e0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:23.979458 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d2079ce2a142a4b97fc4adc25a40e0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:23.985368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1246/2481] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:55:23 2022] DELETE /identity/v3/users/91d2079ce2a142a4b97fc4adc25a40e0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:55:23.989707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:23.996744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:23.996744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:24.009065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:24.010379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:24.068088 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1236/2482] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:24.077568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:24.079004 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:24.158436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a841277-8f30-42a5-a29a-e819f4b0420c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:24.161950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a703c-6eff-4441-8b4b-e3147b8e34bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:24.162540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a703c-6eff-4441-8b4b-e3147b8e34bb service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:24.162833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a703c-6eff-4441-8b4b-e3147b8e34bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:24.163188 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a703c-6eff-4441-8b4b-e3147b8e34bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:24.171989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a703c-6eff-4441-8b4b-e3147b8e34bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:24.173395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a703c-6eff-4441-8b4b-e3147b8e34bb service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:24.183123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1247/2483] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:24.595104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:24.597073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:24.608688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103671f7-6de4-444d-846e-8531965d4b9b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:24.614182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:24.614801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:24.615272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:24.615411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] PATH_INFO: `/v3/projects/6977baf36979451b91b47c04ba2db2b3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:24.616537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6977baf36979451b91b47c04ba2db2b3)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:24.618442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:24.721442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6977baf36979451b91b47c04ba2db2b3', 'request_id': 'req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:24.727739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6977baf36979451b91b47c04ba2db2b3', 'request_id': 'req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:24.788861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6977baf36979451b91b47c04ba2db2b3', 'request_id': 'req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:24.799289 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] The token cache is being invalidate because project 6977baf36979451b91b47c04ba2db2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:55:24.799569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:24.800183 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c85a7718-3261-4afc-b0b1-7ab6d2df7d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:24.801670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1237/2484] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:55:24 2022] DELETE /identity/v3/projects/6977baf36979451b91b47c04ba2db2b3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:24.806461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299feb3f-34a8-4cab-9d94-9dc4a6a88773 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:24.806917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299feb3f-34a8-4cab-9d94-9dc4a6a88773 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:24.807027 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299feb3f-34a8-4cab-9d94-9dc4a6a88773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:24.826200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-299feb3f-34a8-4cab-9d94-9dc4a6a88773 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:24.827413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-299feb3f-34a8-4cab-9d94-9dc4a6a88773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:24.887885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1248/2485] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:24.896383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eef25-7381-4e3d-a1ce-ede87400b774 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:24.896664 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eef25-7381-4e3d-a1ce-ede87400b774 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:24.896934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eef25-7381-4e3d-a1ce-ede87400b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:24.916900 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-7a5eef25-7381-4e3d-a1ce-ede87400b774 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:24.918099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7a5eef25-7381-4e3d-a1ce-ede87400b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:24.925993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1238/2486] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:24.930127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299feb3f-34a8-4cab-9d94-9dc4a6a88773 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:24.939999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299feb3f-34a8-4cab-9d94-9dc4a6a88773 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:24.944649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:24.945281 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:24.945543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:24.945814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:24.946484 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:55:24.946816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:24.948441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:24.957411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:24.960675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1249/2487] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:55:24.964869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eef25-7381-4e3d-a1ce-ede87400b774 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:24.974785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eef25-7381-4e3d-a1ce-ede87400b774 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:24.979710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:24.980301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:24.980580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:24.980849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:24.981478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:24.983462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.092412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1239/2488] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:24 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:25.096542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.106651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eb232-1b48-4d74-a034-301912c4871c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.162539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.163138 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.163444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.163716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.164336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.166343 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.269200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1250/2489] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:25 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:25.273251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.283825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f174-37f8-48c1-b894-86a0a3504d0c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.288500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.289087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.289460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.289738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.290401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.292097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.301936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1240/2490] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:25.305766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.316187 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba138-c083-43f6-9b86-904035294723 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.320960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed170b-31eb-4280-9d53-9f49d0c2b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.321547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed170b-31eb-4280-9d53-9f49d0c2b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.321825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed170b-31eb-4280-9d53-9f49d0c2b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.322167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed170b-31eb-4280-9d53-9f49d0c2b1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.322812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed170b-31eb-4280-9d53-9f49d0c2b1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.324448 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed170b-31eb-4280-9d53-9f49d0c2b1b7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.335605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1251/2491] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:25.339538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.344573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:25.349753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66d590-7e88-48e9-96c2-eb438df2017e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.354460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.355090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.359347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.359347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] PATH_INFO: `/v3/projects/bc52fce36e21424bab8e7d64787ca151/users/2e239d4d254e4357966bd58c1abc86cb/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.370329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc52fce36e21424bab8e7d64787ca151, user_id=2e239d4d254e4357966bd58c1abc86cb, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.373064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.440062 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1241/2492] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:25 2022] PUT /identity/v3/projects/bc52fce36e21424bab8e7d64787ca151/users/2e239d4d254e4357966bd58c1abc86cb/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:55:25.451487 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ec7a-3a4d-4921-b142-6c02b3f193ea None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.451845 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ec7a-3a4d-4921-b142-6c02b3f193ea None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.452121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84ec7a-3a4d-4921-b142-6c02b3f193ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.480680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-0a84ec7a-3a4d-4921-b142-6c02b3f193ea None None] MFA Rules not processed for user `2e239d4d254e4357966bd58c1abc86cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:25.481900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0a84ec7a-3a4d-4921-b142-6c02b3f193ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:25.549694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1252/2493] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:25.554279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.622458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dffb-10d5-4328-9824-bea67eb89050 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.627400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.628034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.628308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.628578 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.629280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.631241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.711207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1242/2494] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:25 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:25.715476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84ec7a-3a4d-4921-b142-6c02b3f193ea None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.733891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84ec7a-3a4d-4921-b142-6c02b3f193ea None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.790995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.791578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.791855 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.792126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.792747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.794658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.898097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:25.904065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1253/2495] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:25 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:25.908919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.918881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44fa7-b6b1-4dbe-9ac5-5ab247e92fda admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.924764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.925345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.925619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.925887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.926522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.928285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:25.938614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1243/2496] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:25.942569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:25.952709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a2f41-6c16-4554-b0e9-b9a47b284c81 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:25.958102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:25.958745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:25.959025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:25.959338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] PATH_INFO: `/v3/projects/d8f2c895f2284dca88f4cda8ffaacaff/users/ef4f5440b10e4dee9e7d128a066201a6/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:25.974407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f2c895f2284dca88f4cda8ffaacaff, user_id=ef4f5440b10e4dee9e7d128a066201a6, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:25.977208 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:26.052721 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1254/2497] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:25 2022] PUT /identity/v3/projects/d8f2c895f2284dca88f4cda8ffaacaff/users/ef4f5440b10e4dee9e7d128a066201a6/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:55:26.056587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:26.066463 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcff17-f709-4ec4-9dc2-c5a461f90ea6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:26.123542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826e77-1fac-4d75-9ee1-30aec4cbd203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:26.124220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826e77-1fac-4d75-9ee1-30aec4cbd203 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:26.124497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826e77-1fac-4d75-9ee1-30aec4cbd203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:26.124769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826e77-1fac-4d75-9ee1-30aec4cbd203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:26.125399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826e77-1fac-4d75-9ee1-30aec4cbd203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:26.127014 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826e77-1fac-4d75-9ee1-30aec4cbd203 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:26.137943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1244/2498] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:26.142948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:26.153355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77240e5-cf8a-4dd2-a1da-53aca47b45e0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:26.158398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:26.162677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:26.162677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:26.162677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] PATH_INFO: `/v3/projects/d8f2c895f2284dca88f4cda8ffaacaff/users/ef4f5440b10e4dee9e7d128a066201a6/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:26.162677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f2c895f2284dca88f4cda8ffaacaff, user_id=ef4f5440b10e4dee9e7d128a066201a6, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:26.164315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:26.175256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1255/2499] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:26 2022] PUT /identity/v3/projects/d8f2c895f2284dca88f4cda8ffaacaff/users/ef4f5440b10e4dee9e7d128a066201a6/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:26.185515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388a0e8-c309-4d2d-bbd2-685120528fb3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:26.185799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388a0e8-c309-4d2d-bbd2-685120528fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:26.186077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388a0e8-c309-4d2d-bbd2-685120528fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:26.213883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3388a0e8-c309-4d2d-bbd2-685120528fb3 None None] MFA Rules not processed for user `ef4f5440b10e4dee9e7d128a066201a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:26.215092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3388a0e8-c309-4d2d-bbd2-685120528fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:26.253028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:26.281821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1245/2500] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:26.293308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:26.296640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:26.353246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1384a-f473-4626-bb97-bfd09a9cc293 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:26.356850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c812689-964b-4903-9ba1-a269b3751ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:26.357451 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c812689-964b-4903-9ba1-a269b3751ffd service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:26.357731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c812689-964b-4903-9ba1-a269b3751ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:26.358000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c812689-964b-4903-9ba1-a269b3751ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:26.367289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c812689-964b-4903-9ba1-a269b3751ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:26.368711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c812689-964b-4903-9ba1-a269b3751ffd service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:26.378546 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1256/2501] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:27.211810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388a0e8-c309-4d2d-bbd2-685120528fb3 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:27.275837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388a0e8-c309-4d2d-bbd2-685120528fb3 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:27.280553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:27.281207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:27.281517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:27.281791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] PATH_INFO: `/v3/users/2e239d4d254e4357966bd58c1abc86cb` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:27.283468 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e239d4d254e4357966bd58c1abc86cb)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:27.285411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:27.455528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e239d4d254e4357966bd58c1abc86cb'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:27.467548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e239d4d254e4357966bd58c1abc86cb'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:27.474418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e239d4d254e4357966bd58c1abc86cb'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:27.475116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e239d4d254e4357966bd58c1abc86cb'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:27.475790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e239d4d254e4357966bd58c1abc86cb'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:27.543015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1246/2502] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:55:27 2022] DELETE /identity/v3/users/2e239d4d254e4357966bd58c1abc86cb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:27.548185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:27.548732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:27.548833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:27.568105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:27.569323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:27.631731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1257/2503] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:27.642028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:27.643541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:27.706371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4536-5527-4008-87d4-fbbd5560213f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:27.710063 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:27.710734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:27.711011 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:27.711312 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:27.718550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:27.720819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:27.722263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:27.734249 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1247/2504] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:28.201468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:28.202911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:28.217057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347b8cb-7595-4399-9c84-73f674a62dc2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:28.222273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:28.222901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:28.223778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:28.224078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] PATH_INFO: `/v3/projects/bc52fce36e21424bab8e7d64787ca151` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:28.225465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc52fce36e21424bab8e7d64787ca151)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:28.227481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:28.325831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc52fce36e21424bab8e7d64787ca151', 'request_id': 'req-2bfe1d24-a42e-462b-b533-d839af41857c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.331439 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc52fce36e21424bab8e7d64787ca151', 'request_id': 'req-2bfe1d24-a42e-462b-b533-d839af41857c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.333321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:28.406009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc52fce36e21424bab8e7d64787ca151', 'request_id': 'req-2bfe1d24-a42e-462b-b533-d839af41857c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.418340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] The token cache is being invalidate because project bc52fce36e21424bab8e7d64787ca151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:55:28.418626 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.419280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.420815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1258/2505] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:55:28 2022] DELETE /identity/v3/projects/bc52fce36e21424bab8e7d64787ca151 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:28.424895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:28.434490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d5df8-62dc-4f15-86ad-371a35d85990 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:28.490212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:28.490836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:28.491117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:28.491417 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] PATH_INFO: `/v3/users/ef4f5440b10e4dee9e7d128a066201a6` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:28.492523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4f5440b10e4dee9e7d128a066201a6)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:28.494451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:28.722331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4f5440b10e4dee9e7d128a066201a6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.734242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4f5440b10e4dee9e7d128a066201a6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.741571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4f5440b10e4dee9e7d128a066201a6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.742268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4f5440b10e4dee9e7d128a066201a6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.742873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b446aaa9-0329-47ca-a63b-26f001ba3fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4f5440b10e4dee9e7d128a066201a6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:28.822432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1248/2506] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:55:28 2022] DELETE /identity/v3/users/ef4f5440b10e4dee9e7d128a066201a6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:29.225459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:29.229433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:29.239809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1d24-a42e-462b-b533-d839af41857c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:29.297715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:29.298363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.298645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.298916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] PATH_INFO: `/v3/projects/d8f2c895f2284dca88f4cda8ffaacaff` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.300058 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f2c895f2284dca88f4cda8ffaacaff)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:29.301982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:29.406573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f2c895f2284dca88f4cda8ffaacaff', 'request_id': 'req-8be7a62f-86d7-418f-a2d4-d5f4d005d868'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:29.412662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f2c895f2284dca88f4cda8ffaacaff', 'request_id': 'req-8be7a62f-86d7-418f-a2d4-d5f4d005d868'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:29.480265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f2c895f2284dca88f4cda8ffaacaff', 'request_id': 'req-8be7a62f-86d7-418f-a2d4-d5f4d005d868'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:29.491518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] The token cache is being invalidate because project d8f2c895f2284dca88f4cda8ffaacaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:55:29.491799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:29.492415 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-8be7a62f-86d7-418f-a2d4-d5f4d005d868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:29.494044 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1259/2507] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:55:29 2022] DELETE /identity/v3/projects/d8f2c895f2284dca88f4cda8ffaacaff => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:29.498951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407b32f-449a-4db0-990d-df00e8980921 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.499438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407b32f-449a-4db0-990d-df00e8980921 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.499549 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407b32f-449a-4db0-990d-df00e8980921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.527349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0407b32f-449a-4db0-990d-df00e8980921 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:29.527349 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0407b32f-449a-4db0-990d-df00e8980921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:29.589143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1249/2508] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:29.596767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c9f9-9ae5-4574-bc49-21c1a5663278 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.597052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c9f9-9ae5-4574-bc49-21c1a5663278 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.597325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c9f9-9ae5-4574-bc49-21c1a5663278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.616998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1746c9f9-9ae5-4574-bc49-21c1a5663278 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:29.618209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1746c9f9-9ae5-4574-bc49-21c1a5663278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:29.626395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1260/2509] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:29.631274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407b32f-449a-4db0-990d-df00e8980921 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:29.641184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407b32f-449a-4db0-990d-df00e8980921 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:29.646818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:29.647566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.647901 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.648269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.649044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:55:29.649388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:29.652207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:29.665320 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1250/2510] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:55:29.669344 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746c9f9-9ae5-4574-bc49-21c1a5663278 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:29.678840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746c9f9-9ae5-4574-bc49-21c1a5663278 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:29.683532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:29.684127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.684460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.684738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.685409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:29.687339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:29.771911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1261/2511] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:29 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:29.773041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:29.778435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:29.783674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863415-b183-4245-9537-a227ce81cc30 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:29.838814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:29.839435 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.839711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.839980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.840619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:29.842529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:29.926082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1251/2512] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:29 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:55:29.930316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:29.945100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2d17e-97f4-45c2-b64a-0e6a2ae48f4c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:29.950050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:29.950653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.950939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.951240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.951886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:29.953556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:29.964202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1262/2513] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:29.968491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:29.978650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9a7ca-7bb9-4d62-a419-0437f4ba9413 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:29.984173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2d952-a403-4f3c-a485-eb80961d71a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:29.984815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d952-a403-4f3c-a485-eb80961d71a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:29.985042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d952-a403-4f3c-a485-eb80961d71a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:29.985317 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d952-a403-4f3c-a485-eb80961d71a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:29.986470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2d952-a403-4f3c-a485-eb80961d71a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:29.988106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2d952-a403-4f3c-a485-eb80961d71a5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:29.998746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1252/2514] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:30.003409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.013315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ac20b-365f-4efa-9fa2-29d9cc1c8fd6 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:30.018159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:30.018795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.019074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.019379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] PATH_INFO: `/v3/projects/4d4226d879f54b15984938c3507c283f/users/01a7c9ab0cf941bd9fec7817fbe1e656/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.033643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4226d879f54b15984938c3507c283f, user_id=01a7c9ab0cf941bd9fec7817fbe1e656, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:30.036324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:30.097530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1263/2515] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:30 2022] PUT /identity/v3/projects/4d4226d879f54b15984938c3507c283f/users/01a7c9ab0cf941bd9fec7817fbe1e656/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:30.114097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70da00-d46f-4c80-a14d-b88ca534390b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.114502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70da00-d46f-4c80-a14d-b88ca534390b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.114828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70da00-d46f-4c80-a14d-b88ca534390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.144203 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4d70da00-d46f-4c80-a14d-b88ca534390b None None] MFA Rules not processed for user `01a7c9ab0cf941bd9fec7817fbe1e656`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:30.145412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4d70da00-d46f-4c80-a14d-b88ca534390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:30.207437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1253/2516] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:30.211978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.225236 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:30.272646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839176-a505-43ef-812c-a8b0b3c6df0d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:30.277385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:30.278015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.278495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.278997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.279707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:30.282081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:30.390041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1264/2517] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:30 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:30.395078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70da00-d46f-4c80-a14d-b88ca534390b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.405735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70da00-d46f-4c80-a14d-b88ca534390b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:30.461104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:30.461699 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.461972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.462279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.462913 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:30.464855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:30.532952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:30.537770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1254/2518] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:30 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:55:30.541923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.552300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733ad99-7661-47a6-97d8-132951184822 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:30.556994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:30.557583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.557863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.558134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.558878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:30.560516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:30.571614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1265/2519] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:30.575853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.586650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ac346-d69c-41f2-aea4-67f2babc636a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:30.592772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:30.593451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.593734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.594028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] PATH_INFO: `/v3/projects/9d6269d28b0643188ddf5b65556e993d/users/8103e13a282c4bb3a93cfdb07c3825b5/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.610455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6269d28b0643188ddf5b65556e993d, user_id=8103e13a282c4bb3a93cfdb07c3825b5, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:30.613660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:30.703277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1255/2520] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:30 2022] PUT /identity/v3/projects/9d6269d28b0643188ddf5b65556e993d/users/8103e13a282c4bb3a93cfdb07c3825b5/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:30.707366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.717235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b549c74-6a59-4d98-b9f7-ac1c080bda93 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:30.774214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2b057-b17d-4308-bd28-d2efb74791fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:30.774807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2b057-b17d-4308-bd28-d2efb74791fb admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.775085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2b057-b17d-4308-bd28-d2efb74791fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.775398 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2b057-b17d-4308-bd28-d2efb74791fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.776029 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2b057-b17d-4308-bd28-d2efb74791fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:30.777731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2b057-b17d-4308-bd28-d2efb74791fb admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:30.791968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1266/2521] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:55:30.796021 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.806877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993f2b9-69f8-4e96-8de3-59517a937395 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:30.811492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:30.812131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.812406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.812677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] PATH_INFO: `/v3/projects/9d6269d28b0643188ddf5b65556e993d/users/8103e13a282c4bb3a93cfdb07c3825b5/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.815130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6269d28b0643188ddf5b65556e993d, user_id=8103e13a282c4bb3a93cfdb07c3825b5, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:30.817787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:30.827867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1256/2522] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:30 2022] PUT /identity/v3/projects/9d6269d28b0643188ddf5b65556e993d/users/8103e13a282c4bb3a93cfdb07c3825b5/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:30.838021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8925-e6eb-412b-a3d2-b91b4a26c684 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:30.838305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8925-e6eb-412b-a3d2-b91b4a26c684 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:30.838578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8925-e6eb-412b-a3d2-b91b4a26c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:30.865948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-776c8925-e6eb-412b-a3d2-b91b4a26c684 None None] MFA Rules not processed for user `8103e13a282c4bb3a93cfdb07c3825b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:30.867139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-776c8925-e6eb-412b-a3d2-b91b4a26c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:30.933493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1267/2523] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:55:30.945355 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:30.947102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:31.026141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afed0f-f79a-4f8f-abcd-13d758b2ebf6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:31.029814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:31.030408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:31.030686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:31.030955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:31.040313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:31.041741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:31.051688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1257/2524] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:31.270645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8925-e6eb-412b-a3d2-b91b4a26c684 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:31.280808 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8925-e6eb-412b-a3d2-b91b4a26c684 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:31.284977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5991-3250-45a6-80c7-355c6751dc31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:31.285583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5991-3250-45a6-80c7-355c6751dc31 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:31.285863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5991-3250-45a6-80c7-355c6751dc31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:31.286134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5991-3250-45a6-80c7-355c6751dc31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:31.291619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:31.343214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5991-3250-45a6-80c7-355c6751dc31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:31.344629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5991-3250-45a6-80c7-355c6751dc31 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:31.353501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1268/2525] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:41.051494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:41.181048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:41.242481 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fdf26-99ee-4cbf-93f5-d1d01c2abf83 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:41.247148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:41.247814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:41.248206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:41.248476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] PATH_INFO: `/v3/users/01a7c9ab0cf941bd9fec7817fbe1e656` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:41.249576 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a7c9ab0cf941bd9fec7817fbe1e656)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:41.252181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:41.442974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a7c9ab0cf941bd9fec7817fbe1e656'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:41.455143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a7c9ab0cf941bd9fec7817fbe1e656'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:41.461899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a7c9ab0cf941bd9fec7817fbe1e656'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:41.462598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a7c9ab0cf941bd9fec7817fbe1e656'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:41.463239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a7c9ab0cf941bd9fec7817fbe1e656'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:41.520569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1258/2526] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:55:41 2022] DELETE /identity/v3/users/01a7c9ab0cf941bd9fec7817fbe1e656 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:41.525129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:41.526135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:41.526135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:41.546024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:41.547272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:41.608122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1269/2527] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:41.618318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:41.619750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:41.679294 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abee7b-9271-4e2f-b643-9deaa8314280 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:41.682929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:41.683567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:41.683847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:41.684119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:41.693022 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:41.694401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:41.703685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1259/2528] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:42.087477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:42.089822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:42.101435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a496f3b-9584-4d6d-9276-ea1665bada72 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:42.106026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:42.106783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:42.107064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:42.107352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] PATH_INFO: `/v3/projects/4d4226d879f54b15984938c3507c283f` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:42.108486 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4226d879f54b15984938c3507c283f)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:42.110392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:42.252840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4226d879f54b15984938c3507c283f', 'request_id': 'req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.258121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4226d879f54b15984938c3507c283f', 'request_id': 'req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.354610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4226d879f54b15984938c3507c283f', 'request_id': 'req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.366969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] The token cache is being invalidate because project 4d4226d879f54b15984938c3507c283f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:55:42.367283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.367912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.369436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1270/2529] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:55:42 2022] DELETE /identity/v3/projects/4d4226d879f54b15984938c3507c283f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:42.373423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:42.383035 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eb764-1f92-4a81-9663-159e1d3e65e7 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:42.401612 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:42.440334 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:42.440951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:42.441224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:42.441495 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] PATH_INFO: `/v3/users/8103e13a282c4bb3a93cfdb07c3825b5` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:42.442607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8103e13a282c4bb3a93cfdb07c3825b5)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:42.444590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:42.633241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8103e13a282c4bb3a93cfdb07c3825b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.640328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8103e13a282c4bb3a93cfdb07c3825b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.648456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8103e13a282c4bb3a93cfdb07c3825b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.649176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8103e13a282c4bb3a93cfdb07c3825b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.649829 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d211ca55-dab4-4628-82f7-76c938cf561c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8103e13a282c4bb3a93cfdb07c3825b5'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:42.727045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1260/2530] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:55:42 2022] DELETE /identity/v3/users/8103e13a282c4bb3a93cfdb07c3825b5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:43.082340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:43.088539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:43.096709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe39e0-9ece-4b9a-8b0c-877a074f38a0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:43.131848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:43.160122 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:43.160754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.161031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.161355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] PATH_INFO: `/v3/projects/9d6269d28b0643188ddf5b65556e993d` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.162565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6269d28b0643188ddf5b65556e993d)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:43.164579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:43.285862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6269d28b0643188ddf5b65556e993d', 'request_id': 'req-cafce43e-8939-46a3-a655-550ba1bea1c3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:43.291093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6269d28b0643188ddf5b65556e993d', 'request_id': 'req-cafce43e-8939-46a3-a655-550ba1bea1c3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:43.371244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6269d28b0643188ddf5b65556e993d', 'request_id': 'req-cafce43e-8939-46a3-a655-550ba1bea1c3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:43.384848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] The token cache is being invalidate because project 9d6269d28b0643188ddf5b65556e993d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:55:43.384848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:43.384848 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-cafce43e-8939-46a3-a655-550ba1bea1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:43.385517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1271/2531] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:55:43 2022] DELETE /identity/v3/projects/9d6269d28b0643188ddf5b65556e993d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:43.391949 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c3ad-684d-47e8-abb0-d6be35b3fcde None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.392419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c3ad-684d-47e8-abb0-d6be35b3fcde None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.392536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c3ad-684d-47e8-abb0-d6be35b3fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.412134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ea96c3ad-684d-47e8-abb0-d6be35b3fcde None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:43.413332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ea96c3ad-684d-47e8-abb0-d6be35b3fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:43.471880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1261/2532] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:43.480745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab9ac-7b8b-4690-bfae-e957ac83af15 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.481031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab9ac-7b8b-4690-bfae-e957ac83af15 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.481305 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab9ac-7b8b-4690-bfae-e957ac83af15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.501050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-806ab9ac-7b8b-4690-bfae-e957ac83af15 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:43.502909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-806ab9ac-7b8b-4690-bfae-e957ac83af15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:43.510737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1272/2533] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:55:43.514794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96c3ad-684d-47e8-abb0-d6be35b3fcde None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:43.524638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96c3ad-684d-47e8-abb0-d6be35b3fcde None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:43.529181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:43.529775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.530057 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.530329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.530970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:55:43.531571 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:43.533205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:43.544594 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1262/2534] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:55:43.549279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab9ac-7b8b-4690-bfae-e957ac83af15 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:43.558407 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab9ac-7b8b-4690-bfae-e957ac83af15 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:43.562948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:43.563609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.564495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.564763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.565393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:43.567335 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:43.684023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1273/2535] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:43 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:43.688541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:43.699401 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e520-198e-4c6b-b8bb-6a463373e4b3 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:43.725034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:43.755981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:43.756580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.756859 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.757130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.757768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:43.759739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:43.842616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1263/2536] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:43 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:43.843908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:43.854860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb985b-2aaa-47ac-8246-387bd8f256d6 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:43.859556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:43.860158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.860436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.860708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.861389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:43.863639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:43.876868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1274/2537] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:43.878051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:43.888077 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58fa2a-2a85-4c15-be76-ab983ec3549f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:43.893734 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd9b5a-b883-4871-b14f-1b8b034a032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:43.894331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd9b5a-b883-4871-b14f-1b8b034a032a admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.894640 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd9b5a-b883-4871-b14f-1b8b034a032a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.894912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd9b5a-b883-4871-b14f-1b8b034a032a admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.895593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd9b5a-b883-4871-b14f-1b8b034a032a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:43.897193 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd9b5a-b883-4871-b14f-1b8b034a032a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:43.908078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1264/2538] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:43.912206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:43.922224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ce2c-8c31-45d9-a4d7-f8282664e7e5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:43.927638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:43.928287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:43.928569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:43.928872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] PATH_INFO: `/v3/projects/bdc68b503fed42a896801ecca472469e/users/1e3ae16621b3447a856ac958751ed326/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:43.945007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc68b503fed42a896801ecca472469e, user_id=1e3ae16621b3447a856ac958751ed326, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:43.947769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:44.018193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1275/2539] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:43 2022] PUT /identity/v3/projects/bdc68b503fed42a896801ecca472469e/users/1e3ae16621b3447a856ac958751ed326/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:55:44.028601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b876f-ec9d-4979-91b8-19b28df1c6b7 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:44.028907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b876f-ec9d-4979-91b8-19b28df1c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:44.029181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b876f-ec9d-4979-91b8-19b28df1c6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:44.058551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5f4b876f-ec9d-4979-91b8-19b28df1c6b7 None None] MFA Rules not processed for user `1e3ae16621b3447a856ac958751ed326`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:44.059803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5f4b876f-ec9d-4979-91b8-19b28df1c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:44.122230 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1265/2540] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:44.135132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:44.136844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:44.193392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e774fb-a4c0-4d6b-8d4d-7a9157257a17 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:44.196951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6d62-078c-4545-af26-3d0b3e2b46e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:44.197550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6d62-078c-4545-af26-3d0b3e2b46e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:44.197830 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6d62-078c-4545-af26-3d0b3e2b46e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:44.198100 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6d62-078c-4545-af26-3d0b3e2b46e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:44.206670 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d6d62-078c-4545-af26-3d0b3e2b46e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:44.208119 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d6d62-078c-4545-af26-3d0b3e2b46e1 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:44.212570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:44.216964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1276/2541] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:44.242931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b876f-ec9d-4979-91b8-19b28df1c6b7 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:44.304551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b876f-ec9d-4979-91b8-19b28df1c6b7 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:44.309364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:44.309973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:44.310252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:44.310522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] PATH_INFO: `/v3/users/1e3ae16621b3447a856ac958751ed326` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:44.311653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3ae16621b3447a856ac958751ed326)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:44.313551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:44.437651 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:44.443493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3ae16621b3447a856ac958751ed326'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:44.455461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3ae16621b3447a856ac958751ed326'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:44.462133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3ae16621b3447a856ac958751ed326'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:44.462830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3ae16621b3447a856ac958751ed326'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:44.463502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3ae16621b3447a856ac958751ed326'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:44.554029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1266/2542] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:55:44 2022] DELETE /identity/v3/users/1e3ae16621b3447a856ac958751ed326 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:44.558537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:44.558816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:44.559088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:44.578288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:44.580185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:44.640419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1277/2543] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:44.651582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:44.652837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:44.709657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf177405-638d-48c8-a3fd-1bdbc8bd3ac1 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:44.713173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda6c4f-7cef-4b99-919c-279ef249bd11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:44.713763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda6c4f-7cef-4b99-919c-279ef249bd11 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:44.714043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda6c4f-7cef-4b99-919c-279ef249bd11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:44.714308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda6c4f-7cef-4b99-919c-279ef249bd11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:44.723797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda6c4f-7cef-4b99-919c-279ef249bd11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:44.725250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda6c4f-7cef-4b99-919c-279ef249bd11 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:44.734566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1267/2544] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:45.219374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:45.225870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:45.236701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1db32-3ea2-4dc5-a266-a2a73e4fe5af None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:45.241705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:45.242277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.242554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.242826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] PATH_INFO: `/v3/projects/bdc68b503fed42a896801ecca472469e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.244153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc68b503fed42a896801ecca472469e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:45.246035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:45.360638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc68b503fed42a896801ecca472469e', 'request_id': 'req-bc4b8109-50f6-4817-94f5-349425273e0d'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:45.366921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc68b503fed42a896801ecca472469e', 'request_id': 'req-bc4b8109-50f6-4817-94f5-349425273e0d'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:45.405565 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc68b503fed42a896801ecca472469e', 'request_id': 'req-bc4b8109-50f6-4817-94f5-349425273e0d'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:45.417123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] The token cache is being invalidate because project bdc68b503fed42a896801ecca472469e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:55:45.418534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:45.418534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-bc4b8109-50f6-4817-94f5-349425273e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:55:45.419685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1278/2545] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:55:45 2022] DELETE /identity/v3/projects/bdc68b503fed42a896801ecca472469e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:45.425666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680b666-806d-41cd-80b8-e050560bfafa None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.425952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680b666-806d-41cd-80b8-e050560bfafa None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.426237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680b666-806d-41cd-80b8-e050560bfafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.445399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-7680b666-806d-41cd-80b8-e050560bfafa None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:45.446579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7680b666-806d-41cd-80b8-e050560bfafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:45.503255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1268/2546] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:45.511059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fe912-ff94-4fe2-bbb9-e9037302980e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.511385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fe912-ff94-4fe2-bbb9-e9037302980e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.511688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fe912-ff94-4fe2-bbb9-e9037302980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.531207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-022fe912-ff94-4fe2-bbb9-e9037302980e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:45.532934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-022fe912-ff94-4fe2-bbb9-e9037302980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:45.540878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1279/2547] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:45.544873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680b666-806d-41cd-80b8-e050560bfafa None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:45.555145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680b666-806d-41cd-80b8-e050560bfafa None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:45.559893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:45.560480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.560757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.561030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.561826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:55:45.561991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:45.563624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:45.575018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1269/2548] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:55:45.579352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fe912-ff94-4fe2-bbb9-e9037302980e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:45.589159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fe912-ff94-4fe2-bbb9-e9037302980e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:45.594072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:45.594666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.595553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.595838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.596480 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:45.598380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:45.704034 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1280/2549] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:45 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:45.708775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:45.718746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701f4a4-13ac-46d9-8b9c-cb29ecb13d19 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:45.773620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:45.786583 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:45.787228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.787512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.787785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.788441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:45.790470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:45.884889 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1270/2550] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:45 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:45.889234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:45.900355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f22aeb-42ea-4597-b561-4b2056df8bdf admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:45.905475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:45.905686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.905971 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.906245 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.906888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:45.909168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:45.918974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1281/2551] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:45.922886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:45.932821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052228ca-d93c-4ac9-912a-c5f4a34e7f6c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:45.937420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05f935-4060-4073-80d6-934d38019d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:45.938033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05f935-4060-4073-80d6-934d38019d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.938308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05f935-4060-4073-80d6-934d38019d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.938577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05f935-4060-4073-80d6-934d38019d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.939241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05f935-4060-4073-80d6-934d38019d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:45.940841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05f935-4060-4073-80d6-934d38019d0e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:45.951569 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1271/2552] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:55:45.956090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:45.965876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dadcd-8daf-4402-9a2b-fd8f1cff964d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:45.971104 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:45.971773 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:45.972054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:45.972329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] PATH_INFO: `/v3/projects/158737870bb049b6a31e62b14b45c8ea/users/066b4dc9224344a582800031a954ceac/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:45.987422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158737870bb049b6a31e62b14b45c8ea, user_id=066b4dc9224344a582800031a954ceac, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:45.990075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:46.061512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1282/2553] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:45 2022] PUT /identity/v3/projects/158737870bb049b6a31e62b14b45c8ea/users/066b4dc9224344a582800031a954ceac/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:46.066872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e861-66b1-42ff-8d06-6b85ffd28179 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:46.067170 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e861-66b1-42ff-8d06-6b85ffd28179 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:46.067459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e861-66b1-42ff-8d06-6b85ffd28179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:46.086740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b2e2e861-66b1-42ff-8d06-6b85ffd28179 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:46.088083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b2e2e861-66b1-42ff-8d06-6b85ffd28179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:46.146948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1272/2554] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:46.156775 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:46.158467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:46.182036 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:46.345960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c479-29c8-4136-8393-f46ed2519580 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:46.349728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:46.350326 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:46.350604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:46.354367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:46.360165 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:46.362084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:46.372106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1283/2555] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:55:51.662781 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3b43-458b-411e-8a75-45509b9090ec None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:51.663254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3b43-458b-411e-8a75-45509b9090ec None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:51.663491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3b43-458b-411e-8a75-45509b9090ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:51.724764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-093a3b43-458b-411e-8a75-45509b9090ec None None] MFA Rules not processed for user `066b4dc9224344a582800031a954ceac`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:51.726001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-093a3b43-458b-411e-8a75-45509b9090ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:51.814554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1273/2556] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:55:51.823801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:51.833634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fbbbf-2eaf-4afb-81c7-4d73610ed0fb service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:51.839209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:51.839822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:51.840096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:51.840364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:51.841000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:51.843055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:51.947611 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1284/2557] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:55:51 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:51.950510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a3b43-458b-411e-8a75-45509b9090ec None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:51.963770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a3b43-458b-411e-8a75-45509b9090ec None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:52.016849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:52.023855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:52.024478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:52.024757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:52.025028 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:52.025665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:52.027661 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:52.139996 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1274/2558] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:55:51 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:55:52.145403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:52.156529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656b333-139d-4517-b5dd-18f18e4cf224 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:52.163419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:52.168235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:52.168235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:52.168235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:52.168235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:52.168235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:52.177556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1285/2559] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:52.182958 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:52.194648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb384d-4060-477c-8a8a-ae4016a53153 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:52.200059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:52.200935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:52.201323 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:52.201769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] PATH_INFO: `/v3/projects/a838e7a39439480eb68b781b7628fbb8/users/796c44429b5d4d41a8c51498e40ef8f1/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:52.219414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a838e7a39439480eb68b781b7628fbb8, user_id=796c44429b5d4d41a8c51498e40ef8f1, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:52.222963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:52.332761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1275/2560] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:52 2022] PUT /identity/v3/projects/a838e7a39439480eb68b781b7628fbb8/users/796c44429b5d4d41a8c51498e40ef8f1/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:55:52.336707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:52.349110 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121ac43-f1ac-4ad1-883a-76979386135b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:52.415781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2d2c7-fd57-4919-99f5-c8fb1114bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:52.416505 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d2c7-fd57-4919-99f5-c8fb1114bd02 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:52.416844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d2c7-fd57-4919-99f5-c8fb1114bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:52.417178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d2c7-fd57-4919-99f5-c8fb1114bd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:52.417882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2d2c7-fd57-4919-99f5-c8fb1114bd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:52.419584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2d2c7-fd57-4919-99f5-c8fb1114bd02 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:52.431928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1286/2561] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:55:52.436135 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:52.446866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86f8b9-3b2c-4bb6-b078-cba867b31200 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:52.451694 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:52.452416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:52.452762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:52.453101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] PATH_INFO: `/v3/projects/a838e7a39439480eb68b781b7628fbb8/users/796c44429b5d4d41a8c51498e40ef8f1/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:52.455662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a838e7a39439480eb68b781b7628fbb8, user_id=796c44429b5d4d41a8c51498e40ef8f1, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:52.458415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:52.469767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1276/2562] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:55:52 2022] PUT /identity/v3/projects/a838e7a39439480eb68b781b7628fbb8/users/796c44429b5d4d41a8c51498e40ef8f1/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:55:56.383257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14d51-aece-427e-a109-a325c65dd696 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:56.384672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14d51-aece-427e-a109-a325c65dd696 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:56.385275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14d51-aece-427e-a109-a325c65dd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:56.423698 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-89e14d51-aece-427e-a109-a325c65dd696 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:56.425244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-89e14d51-aece-427e-a109-a325c65dd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:56.491022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1287/2563] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:55:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:55:56.616012 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:56.623309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:56.702617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97103d-8c83-47b8-93f0-13480f9a5081 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:56.709009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:56.709442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:56.709804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:56.709989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:56.720628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:56.724432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:56.735546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1277/2564] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:55:58.035806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c82f-8e73-4bfc-9953-e25cae78e03f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:58.036356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c82f-8e73-4bfc-9953-e25cae78e03f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:58.036356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c82f-8e73-4bfc-9953-e25cae78e03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:58.074954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5146c82f-8e73-4bfc-9953-e25cae78e03f None None] MFA Rules not processed for user `796c44429b5d4d41a8c51498e40ef8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:55:58.076212 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5146c82f-8e73-4bfc-9953-e25cae78e03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:58.090310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:58.198348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1288/2565] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:55:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:55:58.214630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:55:58.218331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:55:58.329177 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e828f-fc2d-45ba-b2a5-603a5f4b1869 service swift] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:55:58.339443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:55:58.340060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:55:58.340339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:55:58.340616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:55:58.404638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:58.458912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:55:58.461732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:55:58.476885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1278/2566] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:55:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:56:01.596791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a358ce-9edc-4aa2-aab9-09a7a21da0de None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:01.597454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a358ce-9edc-4aa2-aab9-09a7a21da0de None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:01.597454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a358ce-9edc-4aa2-aab9-09a7a21da0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:01.617839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f8a358ce-9edc-4aa2-aab9-09a7a21da0de None None] MFA Rules not processed for user `066b4dc9224344a582800031a954ceac`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:56:01.619238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f8a358ce-9edc-4aa2-aab9-09a7a21da0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:01.626781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1289/2567] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:56:08.485955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=12 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:11.611544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=27 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:12.674178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:56:12.675625 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:12.763803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eb4ac-a000-46fd-b4fb-b34b7400bc46 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:56:12.769904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca85a-e6bb-4349-82c1-b720a16d1a7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:56:12.770535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca85a-e6bb-4349-82c1-b720a16d1a7b service placement] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:12.770828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca85a-e6bb-4349-82c1-b720a16d1a7b service placement] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:12.771097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca85a-e6bb-4349-82c1-b720a16d1a7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:12.772833 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-60bca85a-e6bb-4349-82c1-b720a16d1a7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:12.784837 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bca85a-e6bb-4349-82c1-b720a16d1a7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:56:12.786554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bca85a-e6bb-4349-82c1-b720a16d1a7b service placement] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:56:12.796224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1279/2568] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:56:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:56:15.739780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202e2b9-ec37-4b29-91b7-f1bfa221f6c8 None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:15.740330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202e2b9-ec37-4b29-91b7-f1bfa221f6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:15.740330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202e2b9-ec37-4b29-91b7-f1bfa221f6c8 None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:15.741686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1290/2569] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:56:15.747787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645be48-bc46-4164-a0b4-016a5243006a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:15.748613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645be48-bc46-4164-a0b4-016a5243006a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:15.749150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645be48-bc46-4164-a0b4-016a5243006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:15.777493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1645be48-bc46-4164-a0b4-016a5243006a None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:56:15.778771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1645be48-bc46-4164-a0b4-016a5243006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:15.789325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1280/2570] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:56:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:56:15.800659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202e2b9-ec37-4b29-91b7-f1bfa221f6c8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:56:15.802517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6202e2b9-ec37-4b29-91b7-f1bfa221f6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:15.859907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202e2b9-ec37-4b29-91b7-f1bfa221f6c8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:56:15.863457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77779855-6d52-43c6-9293-60e3c0c7c82e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:56:15.864059 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77779855-6d52-43c6-9293-60e3c0c7c82e service glance] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:15.864363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77779855-6d52-43c6-9293-60e3c0c7c82e service glance] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:15.864636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77779855-6d52-43c6-9293-60e3c0c7c82e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:15.874408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77779855-6d52-43c6-9293-60e3c0c7c82e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:56:15.875893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77779855-6d52-43c6-9293-60e3c0c7c82e service glance] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:56:15.886601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1291/2571] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:56:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:56:16.043494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b31c-a39e-4ea6-b21e-667b590c1f54 None None] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:16.043773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b31c-a39e-4ea6-b21e-667b590c1f54 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:16.044041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b31c-a39e-4ea6-b21e-667b590c1f54 None None] PATH_INFO: `/` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:16.045420 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1281/2572] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:56:16.050399 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f0c18-32cf-41b6-b9cf-77d888e29b07 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:16.050689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f0c18-32cf-41b6-b9cf-77d888e29b07 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:16.050961 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f0c18-32cf-41b6-b9cf-77d888e29b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:16.070823 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d97f0c18-32cf-41b6-b9cf-77d888e29b07 None None] MFA Rules not processed for user `94c7e57c93dd49a1a3e784002ae94fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:56:16.072055 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d97f0c18-32cf-41b6-b9cf-77d888e29b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:16.122466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1292/2573] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:56:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:56:16.134797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632b31c-a39e-4ea6-b21e-667b590c1f54 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:56:16.146666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632b31c-a39e-4ea6-b21e-667b590c1f54 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:56:16.150227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf4125-41d9-45bb-a1a4-b6b7fa42d6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:56:16.150813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4125-41d9-45bb-a1a4-b6b7fa42d6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:16.151092 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4125-41d9-45bb-a1a4-b6b7fa42d6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:16.151454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf4125-41d9-45bb-a1a4-b6b7fa42d6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:16.158393 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4125-41d9-45bb-a1a4-b6b7fa42d6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:56:16.159810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf4125-41d9-45bb-a1a4-b6b7fa42d6a4 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:56:16.167650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1282/2574] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:56:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:56:16.248781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78855f87-351a-49c1-9137-c327cf88fc5c None None] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:16.249068 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78855f87-351a-49c1-9137-c327cf88fc5c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:16.249338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78855f87-351a-49c1-9137-c327cf88fc5c None None] PATH_INFO: `/` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:16.251222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1293/2575] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 1 16:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:56:16.256338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876175-ad63-4b98-a7e5-8957767f2ef6 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:16.256624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876175-ad63-4b98-a7e5-8957767f2ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:16.256920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876175-ad63-4b98-a7e5-8957767f2ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:16.276979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-15876175-ad63-4b98-a7e5-8957767f2ef6 None None] MFA Rules not processed for user `1276878b8f0541398e54be24543abd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:56:16.278179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-15876175-ad63-4b98-a7e5-8957767f2ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:16.287523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1283/2576] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 1 16:56:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:56:16.297769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78855f87-351a-49c1-9137-c327cf88fc5c None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:56:16.299454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-78855f87-351a-49c1-9137-c327cf88fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:16.312580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78855f87-351a-49c1-9137-c327cf88fc5c None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:56:16.316634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:56:16.317214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:16.317483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:16.317748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:16.327564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:56:16.329615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:56:16.340025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1294/2577] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:56:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:56:19.190482 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661dd5b-4fa7-466b-8605-61354c9d5099 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:19.190989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661dd5b-4fa7-466b-8605-61354c9d5099 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:19.191329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661dd5b-4fa7-466b-8605-61354c9d5099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:19.211696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4661dd5b-4fa7-466b-8605-61354c9d5099 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:56:19.212928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4661dd5b-4fa7-466b-8605-61354c9d5099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:19.220109 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1284/2578] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:56:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:56:19.232342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:56:19.243489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3780a-4762-4634-98d3-c394e3b1d7b4 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:56:19.248559 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:56:19.249149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:19.249426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:19.249749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:19.259691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:56:19.260070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:56:19.269541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1295/2579] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:29.205335 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=56 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:29.265108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=61 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:40.277932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992da7-90ab-4f87-a4ea-81c9e50294fe None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:40.278498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992da7-90ab-4f87-a4ea-81c9e50294fe None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:40.278498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992da7-90ab-4f87-a4ea-81c9e50294fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:40.298212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-85992da7-90ab-4f87-a4ea-81c9e50294fe None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:56:40.299485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-85992da7-90ab-4f87-a4ea-81c9e50294fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:56:40.307494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1285/2580] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 1 16:56:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:56:40.320196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:56:40.331064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38075a74-fb0f-4313-8d46-318a97151ab9 service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:56:40.336793 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:56:40.337418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:40.337668 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:40.337941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:40.346355 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:56:40.348525 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:56:40.356692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1296/2581] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:56:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:50.292804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:50.353747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:51.546871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992da7-90ab-4f87-a4ea-81c9e50294fe None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:56:51.556354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992da7-90ab-4f87-a4ea-81c9e50294fe None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:56:51.560221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:56:51.560811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:56:51.561115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:56:51.561384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:56:51.570820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:56:51.572398 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:56:51.582546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1286/2582] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:56:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:57:01.577632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=6 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:57:07.179713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:07.188893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bd52-0e20-4a15-9663-72c7748a2d21 service swift] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:07.192542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:07.193654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:07.193948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:07.194195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:07.195932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:07.257603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:07.259023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:07.268705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1297/2583] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:57:10.866153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:10.867796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:10.882512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ef8c0-2f77-4ea3-9162-4d912c2b380b service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:10.887003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:10.890078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:10.890078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:10.890078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] PATH_INFO: `/v3/users/90c1309ba78a46f0b3a4cd67c4c89542` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:10.890078 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c1309ba78a46f0b3a4cd67c4c89542)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:10.891377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:11.060400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c1309ba78a46f0b3a4cd67c4c89542'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.073032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c1309ba78a46f0b3a4cd67c4c89542'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.079704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c1309ba78a46f0b3a4cd67c4c89542'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.080391 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c1309ba78a46f0b3a4cd67c4c89542'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.080988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-8ddd6284-e622-41e9-9dcc-ab5475ee25f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c1309ba78a46f0b3a4cd67c4c89542'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.182799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1287/2584] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:57:10 2022] DELETE /identity/v3/users/90c1309ba78a46f0b3a4cd67c4c89542 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:57:11.464141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:11.475617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cb4ce-6089-4901-8d2a-6c9e6200e3bb service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:11.533659 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:11.534277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:11.534551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:11.534814 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] PATH_INFO: `/v3/projects/f19e29d5ccc24e41bb2de472fdc2deb2` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:11.545315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19e29d5ccc24e41bb2de472fdc2deb2)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:11.548905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:11.633413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19e29d5ccc24e41bb2de472fdc2deb2', 'request_id': 'req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.638959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19e29d5ccc24e41bb2de472fdc2deb2', 'request_id': 'req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.736982 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19e29d5ccc24e41bb2de472fdc2deb2', 'request_id': 'req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.749223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] The token cache is being invalidate because project f19e29d5ccc24e41bb2de472fdc2deb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:57:11.749512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.750144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a284b4fa-04ac-4f7f-aed9-210fd2de4fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:57:11.751665 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1298/2585] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:57:11 2022] DELETE /identity/v3/projects/f19e29d5ccc24e41bb2de472fdc2deb2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:57:11.756691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3492-8cb7-4c14-9576-4fe6bbd7d591 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:11.760750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3492-8cb7-4c14-9576-4fe6bbd7d591 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:11.760750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3492-8cb7-4c14-9576-4fe6bbd7d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:11.777648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-825c3492-8cb7-4c14-9576-4fe6bbd7d591 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:57:11.778886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-825c3492-8cb7-4c14-9576-4fe6bbd7d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:11.837945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1288/2586] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:57:11.846847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09a7c4-def0-44e2-9ad5-5b0bb4760b36 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:11.847517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09a7c4-def0-44e2-9ad5-5b0bb4760b36 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:11.847799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09a7c4-def0-44e2-9ad5-5b0bb4760b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:11.867962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3f09a7c4-def0-44e2-9ad5-5b0bb4760b36 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:57:11.869902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3f09a7c4-def0-44e2-9ad5-5b0bb4760b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:11.878541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1299/2587] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:57:11.883132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3492-8cb7-4c14-9576-4fe6bbd7d591 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:11.893801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3492-8cb7-4c14-9576-4fe6bbd7d591 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:11.899103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:11.899723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:11.899999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:11.900270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:11.900915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:57:11.901216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:11.902811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:11.914965 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1289/2588] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:57:11.919352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09a7c4-def0-44e2-9ad5-5b0bb4760b36 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:11.928477 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09a7c4-def0-44e2-9ad5-5b0bb4760b36 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:11.933120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:11.933704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:11.933980 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:11.934248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:11.934872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:11.936807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:11.941771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:57:12.041455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1300/2589] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:57:11 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:57:12.050718 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:12.060814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ad1b2-e4b9-42fe-b510-3b0d5d33447f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:12.117379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:12.117985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:12.118290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:12.118608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:12.119271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:12.121204 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:12.129292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:57:12.216891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1290/2590] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:57:12 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:57:12.220966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:12.231127 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4019d91-76b0-4ff2-822f-537a6bf00612 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:12.235831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:12.236467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:12.236753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:12.237032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:12.237684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:12.239351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:12.249442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1301/2591] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:57:12.254066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:12.264190 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131fc25-586f-4072-9d1e-977ec3ee596b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:12.269414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60cfac-443a-499c-9247-127e67684ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:12.269999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60cfac-443a-499c-9247-127e67684ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:12.270290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60cfac-443a-499c-9247-127e67684ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:12.270560 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60cfac-443a-499c-9247-127e67684ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:12.271959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60cfac-443a-499c-9247-127e67684ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:12.273544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60cfac-443a-499c-9247-127e67684ad5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:12.283911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1291/2592] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:57:12.288130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:12.298050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b8f1-4dc6-4ac9-8d1a-36af75f17130 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:12.302650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:12.303644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:12.303931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:12.304207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] PATH_INFO: `/v3/projects/7bace4ad0f1a48398b522a0f9ee0e9cd/users/f0c5ed608ce044c192d2710b27f2e8bf/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:12.319271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bace4ad0f1a48398b522a0f9ee0e9cd, user_id=f0c5ed608ce044c192d2710b27f2e8bf, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:12.321924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:12.388573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1302/2593] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:57:12 2022] PUT /identity/v3/projects/7bace4ad0f1a48398b522a0f9ee0e9cd/users/f0c5ed608ce044c192d2710b27f2e8bf/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:57:12.393960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e789bc-f576-45b4-a391-1a6d36da2010 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:12.394247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e789bc-f576-45b4-a391-1a6d36da2010 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:12.394527 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e789bc-f576-45b4-a391-1a6d36da2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:12.415148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-22e789bc-f576-45b4-a391-1a6d36da2010 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:57:12.416386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-22e789bc-f576-45b4-a391-1a6d36da2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:12.473921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1292/2594] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:57:12.483727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:12.485372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:12.542661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a90a7-a829-4241-aebe-06c37cc2d9eb admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:12.546237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:12.546827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:12.547105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:12.547414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:12.560757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:12.560757 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:12.567130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1303/2595] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:57:17.773094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c988-9134-4520-8808-34800cb5a70b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:17.773616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c988-9134-4520-8808-34800cb5a70b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:17.773616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c988-9134-4520-8808-34800cb5a70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:17.805906 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1fe8c988-9134-4520-8808-34800cb5a70b None None] MFA Rules not processed for user `f0c5ed608ce044c192d2710b27f2e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:57:17.807491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1fe8c988-9134-4520-8808-34800cb5a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:17.891521 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1293/2596] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:57:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:57:17.911289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:17.912242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:17.996256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d63836-2e40-49a3-9b03-5e9eefae5614 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:18.002758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:18.003395 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:18.003675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:18.003946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:18.011893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:18.013468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:18.023719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1304/2597] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:57:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:57:20.289441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:20.289928 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:20.290043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:20.311266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] MFA Rules not processed for user `f0c5ed608ce044c192d2710b27f2e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:57:20.312597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:20.320649 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1294/2598] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:57:20.359704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:20.361148 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:20.403256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:57:20.427767 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bdd8-7c2c-4498-ae70-1fe4365df9e9 service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:20.432158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:20.432824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:20.433282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:20.433727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:20.435515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:20.450318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:20.451833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:20.464066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1305/2599] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:57:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:57:21.162921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:21.164476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:21.177134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35d7ca-3695-4ed9-b062-67cfb6642821 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:21.181100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:21.181812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:21.182266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:21.182679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:21.184638 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:21.199184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:21.200624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:21.214800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1295/2600] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:57:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:57:30.560185 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=12 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:57:31.207955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:INSERT=3,keystone:SELECT=75 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:57:59.876337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:57:59.885460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca201e7-a8c4-4991-a3f2-57d042383242 service glance] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:57:59.889413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:57:59.889993 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:57:59.890266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:57:59.890530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:57:59.892311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:57:59.904421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:57:59.905818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:57:59.915133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1306/2601] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:58:03.269434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:03.271030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:03.285898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5e1e7-dd8e-4ebc-b836-0e5508fd048a service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:03.290685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:03.291364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:03.291641 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:03.291920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] PATH_INFO: `/v3/users/1500bceab76f41c5b3e69e1cf55117aa` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:03.308076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1500bceab76f41c5b3e69e1cf55117aa)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:03.310572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:03.464568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1500bceab76f41c5b3e69e1cf55117aa'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:03.477974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1500bceab76f41c5b3e69e1cf55117aa'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:03.484786 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1500bceab76f41c5b3e69e1cf55117aa'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:03.485461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1500bceab76f41c5b3e69e1cf55117aa'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:03.486075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-340b7e52-62f1-4036-8f3f-23bf37c67fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1500bceab76f41c5b3e69e1cf55117aa'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:03.547581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1296/2602] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:58:03 2022] DELETE /identity/v3/users/1500bceab76f41c5b3e69e1cf55117aa => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:03.772746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:03.785342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae1932-2cf9-4f7e-a194-df3c371105df service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:03.843417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:03.844064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:03.844340 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:03.844613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] PATH_INFO: `/v3/projects/7020cb9098f74e67aa08e9db52b6d231` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:03.857563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7020cb9098f74e67aa08e9db52b6d231)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:03.859564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:03.970669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7020cb9098f74e67aa08e9db52b6d231', 'request_id': 'req-99993220-df73-48a6-84af-cf2e547f81f8'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:03.976230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7020cb9098f74e67aa08e9db52b6d231', 'request_id': 'req-99993220-df73-48a6-84af-cf2e547f81f8'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:04.077983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7020cb9098f74e67aa08e9db52b6d231', 'request_id': 'req-99993220-df73-48a6-84af-cf2e547f81f8'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:04.089849 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] The token cache is being invalidate because project 7020cb9098f74e67aa08e9db52b6d231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:58:04.090136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:04.090763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-99993220-df73-48a6-84af-cf2e547f81f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:04.092258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1307/2603] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:58:03 2022] DELETE /identity/v3/projects/7020cb9098f74e67aa08e9db52b6d231 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:04.097318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792e49-326e-4724-8d71-55461b34163a None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.097604 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792e49-326e-4724-8d71-55461b34163a None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.097894 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792e49-326e-4724-8d71-55461b34163a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.117284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6c792e49-326e-4724-8d71-55461b34163a None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:04.118467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6c792e49-326e-4724-8d71-55461b34163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:04.177098 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1297/2604] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:04.185464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ee88-4baa-4955-a97e-df9dc406ebe8 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.185748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ee88-4baa-4955-a97e-df9dc406ebe8 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.186018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ee88-4baa-4955-a97e-df9dc406ebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.205916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-d083ee88-4baa-4955-a97e-df9dc406ebe8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:04.207102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-d083ee88-4baa-4955-a97e-df9dc406ebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:04.214866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1308/2605] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:04.218948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792e49-326e-4724-8d71-55461b34163a None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:04.228547 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792e49-326e-4724-8d71-55461b34163a None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:04.233228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:04.234240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.234714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.235251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.235910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:58:04.236216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:04.238627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:04.251209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1298/2606] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:58:04.255465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ee88-4baa-4955-a97e-df9dc406ebe8 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:04.265134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ee88-4baa-4955-a97e-df9dc406ebe8 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:04.270011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:04.270593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.270872 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.271140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.271805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:04.273712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:04.400541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1309/2607] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:58:04 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:04.404544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:04.414486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626f7de-0d20-4e02-981e-d7aecd58e71d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:04.459466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:04.471044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:04.471787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.472067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.472339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.472984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:04.474909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:04.605214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1299/2608] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:58:04 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:04.609666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:04.619710 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4497c4-f420-44b8-b6d8-c1c0377afae1 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:04.624820 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:04.625403 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.625676 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.625943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.626624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:04.628231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:04.637873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1310/2609] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:04.641813 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:04.652036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894526-3cc8-4aff-a70c-ab0e6c47725b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:04.656630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c362b9e-173b-495f-baf5-324a8ac6e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:04.657221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c362b9e-173b-495f-baf5-324a8ac6e7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.657491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c362b9e-173b-495f-baf5-324a8ac6e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.657757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c362b9e-173b-495f-baf5-324a8ac6e7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.658388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c362b9e-173b-495f-baf5-324a8ac6e7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:04.660130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c362b9e-173b-495f-baf5-324a8ac6e7f3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:04.671340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1300/2610] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:04.675411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:04.685838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9b23-bcfc-4939-914b-da1fd8850c9a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:04.690314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:04.690942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.691247 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.691518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] PATH_INFO: `/v3/projects/75326afa113b476a9d739fc6513c3c90/users/1f55e470c54d483e96864bb588283232/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.706149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75326afa113b476a9d739fc6513c3c90, user_id=1f55e470c54d483e96864bb588283232, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:04.708847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:04.776362 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1311/2611] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:58:04 2022] PUT /identity/v3/projects/75326afa113b476a9d739fc6513c3c90/users/1f55e470c54d483e96864bb588283232/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:04.787243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977cf46-5ef2-4ce1-9bdf-ee015a31b25d None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.787550 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977cf46-5ef2-4ce1-9bdf-ee015a31b25d None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.787817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977cf46-5ef2-4ce1-9bdf-ee015a31b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.815779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-6977cf46-5ef2-4ce1-9bdf-ee015a31b25d None None] MFA Rules not processed for user `1f55e470c54d483e96864bb588283232`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:04.816971 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6977cf46-5ef2-4ce1-9bdf-ee015a31b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:04.879247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1301/2612] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:04.889693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:04.891389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:04.898024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:04.947727 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494209a-af32-4cd4-968a-85b82b308015 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:04.951382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d70826-0a40-46d0-9a55-2e24f7603122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:04.951974 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70826-0a40-46d0-9a55-2e24f7603122 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:04.952252 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70826-0a40-46d0-9a55-2e24f7603122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:04.952563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70826-0a40-46d0-9a55-2e24f7603122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:04.960795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d70826-0a40-46d0-9a55-2e24f7603122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:04.962211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d70826-0a40-46d0-9a55-2e24f7603122 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:04.972003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1312/2613] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:58:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:58:14.876340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:14.999736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=24 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:15.597258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977cf46-5ef2-4ce1-9bdf-ee015a31b25d None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:15.659838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977cf46-5ef2-4ce1-9bdf-ee015a31b25d None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:15.664332 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:15.664960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:15.672708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:15.672708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] PATH_INFO: `/v3/users/1f55e470c54d483e96864bb588283232` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:15.672708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f55e470c54d483e96864bb588283232)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:15.672708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:15.835931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f55e470c54d483e96864bb588283232'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:15.848927 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f55e470c54d483e96864bb588283232'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:15.855749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f55e470c54d483e96864bb588283232'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:15.859107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f55e470c54d483e96864bb588283232'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:15.859107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f55e470c54d483e96864bb588283232'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:15.940016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1302/2614] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:58:15 2022] DELETE /identity/v3/users/1f55e470c54d483e96864bb588283232 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:15.944541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:15.947876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:15.947876 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:15.964164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:15.965351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:16.023123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1313/2615] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:16.033513 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:16.034936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:16.091099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6795a-4af7-4c93-8816-7ab6789b2a2c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:16.095346 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc5604-40ad-41ca-ad5a-3324fde5a980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:16.095948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5604-40ad-41ca-ad5a-3324fde5a980 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:16.096226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5604-40ad-41ca-ad5a-3324fde5a980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:16.096499 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5604-40ad-41ca-ad5a-3324fde5a980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:16.105356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc5604-40ad-41ca-ad5a-3324fde5a980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:16.106778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc5604-40ad-41ca-ad5a-3324fde5a980 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:16.116129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1303/2616] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:58:16.528288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:16.529712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:16.541384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c1b9c-a04c-4790-93ab-0d512aadcae6 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:16.546184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:16.546807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:16.547183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:16.547389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] PATH_INFO: `/v3/projects/75326afa113b476a9d739fc6513c3c90` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:16.548494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75326afa113b476a9d739fc6513c3c90)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:16.550376 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:16.673909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75326afa113b476a9d739fc6513c3c90', 'request_id': 'req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:16.679621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75326afa113b476a9d739fc6513c3c90', 'request_id': 'req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:16.759108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75326afa113b476a9d739fc6513c3c90', 'request_id': 'req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:16.770498 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] The token cache is being invalidate because project 75326afa113b476a9d739fc6513c3c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:58:16.770782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:16.771490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6a5ff9a7-819a-4f63-bcb3-56f89d21d129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:16.772941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1314/2617] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:58:16 2022] DELETE /identity/v3/projects/75326afa113b476a9d739fc6513c3c90 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:58:16.777802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ed17-1ade-4814-bfb9-ad1712397a00 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:16.778089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ed17-1ade-4814-bfb9-ad1712397a00 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:16.778365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ed17-1ade-4814-bfb9-ad1712397a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:16.798325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4328ed17-1ade-4814-bfb9-ad1712397a00 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:16.799548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4328ed17-1ade-4814-bfb9-ad1712397a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:16.819951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:16.863208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1304/2618] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:16.870857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c924-1a2d-4708-b166-6388796fdfbe None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:16.871141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c924-1a2d-4708-b166-6388796fdfbe None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:16.871452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c924-1a2d-4708-b166-6388796fdfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:16.891374 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4d88c924-1a2d-4708-b166-6388796fdfbe None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:16.892761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4d88c924-1a2d-4708-b166-6388796fdfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:16.900511 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1315/2619] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:16.904658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ed17-1ade-4814-bfb9-ad1712397a00 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:16.914158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ed17-1ade-4814-bfb9-ad1712397a00 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:16.919269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:16.919853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:16.920129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:16.920397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:16.921041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:58:16.921340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:16.923490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:16.934838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1305/2620] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:58:16.939470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c924-1a2d-4708-b166-6388796fdfbe None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:16.948361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c924-1a2d-4708-b166-6388796fdfbe None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:16.952912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:16.953524 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:16.953801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:16.954071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:16.954696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:16.956685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.023652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1316/2621] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:17.027701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.037708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a704a-8b38-4433-b1c1-deb4f3568180 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.093848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.094940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.095252 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.095519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.096144 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.098076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.182556 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1306/2622] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:58:17 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:17.186574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.197033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c3872-0870-49f5-aa23-33d9e00c5507 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.201674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.202254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.202528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.202795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.203545 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.205137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.214803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1317/2623] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:17.218790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.229333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90062e-fe72-4a6b-b531-f1aafb34d93d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.233912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7a18-35aa-4ba1-9215-cb5ecd640510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.234498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7a18-35aa-4ba1-9215-cb5ecd640510 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.234777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7a18-35aa-4ba1-9215-cb5ecd640510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.235050 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7a18-35aa-4ba1-9215-cb5ecd640510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.235722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7a18-35aa-4ba1-9215-cb5ecd640510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.237919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7a18-35aa-4ba1-9215-cb5ecd640510 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.248121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1307/2624] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:17.252087 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.262002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a300-60d7-49b0-aabd-6acfb54f930f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.266583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.267251 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.267780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.268062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] PATH_INFO: `/v3/projects/1f2220c9b5ad40d1bb4fb5ac51139b91/users/d218cc2ff3a54882bc3896992b1712b9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.282136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2220c9b5ad40d1bb4fb5ac51139b91, user_id=d218cc2ff3a54882bc3896992b1712b9, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.285303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.376400 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1318/2625] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:58:17 2022] PUT /identity/v3/projects/1f2220c9b5ad40d1bb4fb5ac51139b91/users/d218cc2ff3a54882bc3896992b1712b9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:17.387123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60dad8-13c0-4d57-a3bc-7445f6f21fc8 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.387426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60dad8-13c0-4d57-a3bc-7445f6f21fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.387975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60dad8-13c0-4d57-a3bc-7445f6f21fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.419261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8d60dad8-13c0-4d57-a3bc-7445f6f21fc8 None None] MFA Rules not processed for user `d218cc2ff3a54882bc3896992b1712b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:17.420478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8d60dad8-13c0-4d57-a3bc-7445f6f21fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:17.489139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1308/2626] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:58:17.489342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.508910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:17.550707 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13d0c-7ec5-44ac-ab7b-f8ede91c47c9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.555349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.555941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.556216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.556485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.557099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.558978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.640008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1319/2627] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:58:17 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:17.645037 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60dad8-13c0-4d57-a3bc-7445f6f21fc8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.659425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60dad8-13c0-4d57-a3bc-7445f6f21fc8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.671520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:17.713775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.714385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.715007 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.715343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.715981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.717881 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.821848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1309/2628] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:58:17 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:17.826125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.837132 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de1fb3-be0a-4713-8711-d06884c1752d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.842107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.842717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.843012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.843315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.843960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.845697 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.856263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1320/2629] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:17.860361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:17.870455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d59789-2101-4c2a-81e2-d6a137357015 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:17.875147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:17.875822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:17.882951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:17.882951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] PATH_INFO: `/v3/projects/ac62ac39387b4cd3b9c8863b609b37a9/users/966bc7a82959407a838befa13437f0fc/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:17.891711 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac62ac39387b4cd3b9c8863b609b37a9, user_id=966bc7a82959407a838befa13437f0fc, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:17.895329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:17.994188 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1310/2630] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:58:17 2022] PUT /identity/v3/projects/ac62ac39387b4cd3b9c8863b609b37a9/users/966bc7a82959407a838befa13437f0fc/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:17.998153 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:18.008093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6fe46-0cbc-49c4-a88a-0e5304001ca8 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:18.063268 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24da87-1c0f-4a63-8c5c-72d2809f9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:18.063892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24da87-1c0f-4a63-8c5c-72d2809f9a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:18.064179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24da87-1c0f-4a63-8c5c-72d2809f9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:18.064446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24da87-1c0f-4a63-8c5c-72d2809f9a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:18.065070 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24da87-1c0f-4a63-8c5c-72d2809f9a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:18.066639 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24da87-1c0f-4a63-8c5c-72d2809f9a8f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:18.076155 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1321/2631] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:18.080226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:18.090247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f94614-a58d-4333-a1a8-b1274c559427 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:18.094743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:18.095917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:18.096189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:18.096454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] PATH_INFO: `/v3/projects/ac62ac39387b4cd3b9c8863b609b37a9/users/966bc7a82959407a838befa13437f0fc/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:18.098374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac62ac39387b4cd3b9c8863b609b37a9, user_id=966bc7a82959407a838befa13437f0fc, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:18.101019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:18.110929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1311/2632] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:58:18 2022] PUT /identity/v3/projects/ac62ac39387b4cd3b9c8863b609b37a9/users/966bc7a82959407a838befa13437f0fc/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:18.122712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9c704-4812-4d9b-8088-43896bbfa81f None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:18.122997 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9c704-4812-4d9b-8088-43896bbfa81f None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:18.123313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9c704-4812-4d9b-8088-43896bbfa81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:18.150623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-94c9c704-4812-4d9b-8088-43896bbfa81f None None] MFA Rules not processed for user `966bc7a82959407a838befa13437f0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:18.151864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-94c9c704-4812-4d9b-8088-43896bbfa81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:18.216795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1322/2633] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:18.228374 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:18.230056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:18.286024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac6c83-b925-4517-abf9-38c82bcab0ec admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:18.289584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:18.290163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:18.290434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:18.290698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:18.299363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:18.300779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:18.309862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1312/2634] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:58:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:58:18.531925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9c704-4812-4d9b-8088-43896bbfa81f None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:18.542328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9c704-4812-4d9b-8088-43896bbfa81f None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:18.545969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:18.546570 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:18.546850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:18.547121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:18.559035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:18.603334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:18.604885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:18.614141 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1323/2635] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:58:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:58:19.456118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:19.457622 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:19.514264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33044f-3795-4e18-a81d-c1494f119ea1 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:19.518858 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02043c27-1131-4342-a642-74c6ca2b14b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:19.519485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043c27-1131-4342-a642-74c6ca2b14b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:19.519765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043c27-1131-4342-a642-74c6ca2b14b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:19.520036 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043c27-1131-4342-a642-74c6ca2b14b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:19.521748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-02043c27-1131-4342-a642-74c6ca2b14b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:19.530943 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02043c27-1131-4342-a642-74c6ca2b14b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:19.532464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02043c27-1131-4342-a642-74c6ca2b14b7 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:19.540309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1313/2636] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:58:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:58:28.633513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=21 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:29.536819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:56.601951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:56.666001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281db6a-eb21-4665-ab2e-1b4a938e4bfa service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:56.670772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:56.671795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:56.671795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:56.672042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] PATH_INFO: `/v3/users/d218cc2ff3a54882bc3896992b1712b9` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:56.673433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d218cc2ff3a54882bc3896992b1712b9)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:56.675333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:56.828810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd218cc2ff3a54882bc3896992b1712b9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:56.829432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd218cc2ff3a54882bc3896992b1712b9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:56.839494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd218cc2ff3a54882bc3896992b1712b9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:56.901351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd218cc2ff3a54882bc3896992b1712b9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:56.913304 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd218cc2ff3a54882bc3896992b1712b9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:56.919833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1324/2637] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:58:56 2022] DELETE /identity/v3/users/d218cc2ff3a54882bc3896992b1712b9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:56.924415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:56.924916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:56.925019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:56.944686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:56.945899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:57.002974 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1314/2638] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:58:57.012734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:57.014120 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:57.075496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75d15e-27c7-4369-8af1-b4abccfba9d5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:57.079102 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:57.079725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:57.080005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:57.080275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:57.089661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:57.091016 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:57.100619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1325/2639] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:58:57.521153 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:57.522799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:57.535601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8083-9fda-42ef-ac52-3d0670aafe55 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:57.540411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:57.541040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:57.541319 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:57.541595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] PATH_INFO: `/v3/projects/1f2220c9b5ad40d1bb4fb5ac51139b91` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:57.543039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2220c9b5ad40d1bb4fb5ac51139b91)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:57.546957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:57.673600 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2220c9b5ad40d1bb4fb5ac51139b91', 'request_id': 'req-06c0e23c-af6f-4ed9-ade0-5b02f9379910'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:57.680029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2220c9b5ad40d1bb4fb5ac51139b91', 'request_id': 'req-06c0e23c-af6f-4ed9-ade0-5b02f9379910'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:57.768597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2220c9b5ad40d1bb4fb5ac51139b91', 'request_id': 'req-06c0e23c-af6f-4ed9-ade0-5b02f9379910'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:57.779418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] The token cache is being invalidate because project 1f2220c9b5ad40d1bb4fb5ac51139b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:58:57.779698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:57.781739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:57.781739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1315/2640] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:58:57 2022] DELETE /identity/v3/projects/1f2220c9b5ad40d1bb4fb5ac51139b91 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:57.785759 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:57.796169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e48d5-0547-4772-97c0-2304ee5407d9 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:57.814579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:57.852435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:57.853069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:57.853347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:57.853617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] PATH_INFO: `/v3/users/966bc7a82959407a838befa13437f0fc` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:57.854766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966bc7a82959407a838befa13437f0fc)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:57.856701 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:58.024277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966bc7a82959407a838befa13437f0fc'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.024932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966bc7a82959407a838befa13437f0fc'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.031746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966bc7a82959407a838befa13437f0fc'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.095650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966bc7a82959407a838befa13437f0fc'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.108978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0a08843a-ae6f-4b40-ab5e-31e2e0416d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966bc7a82959407a838befa13437f0fc'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.114839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1326/2641] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:58:57 2022] DELETE /identity/v3/users/966bc7a82959407a838befa13437f0fc => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:58.533189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:58.533673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:58.549939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0e23c-af6f-4ed9-ade0-5b02f9379910 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:58.607070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:58.607726 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:58.608009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:58.608281 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] PATH_INFO: `/v3/projects/ac62ac39387b4cd3b9c8863b609b37a9` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:58.609405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac62ac39387b4cd3b9c8863b609b37a9)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:58.611363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:58.709362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:58.727322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac62ac39387b4cd3b9c8863b609b37a9', 'request_id': 'req-d246bf32-d57d-4ee6-a517-6886bedb5ce9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.734163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac62ac39387b4cd3b9c8863b609b37a9', 'request_id': 'req-d246bf32-d57d-4ee6-a517-6886bedb5ce9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.799120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac62ac39387b4cd3b9c8863b609b37a9', 'request_id': 'req-d246bf32-d57d-4ee6-a517-6886bedb5ce9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.810254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] The token cache is being invalidate because project ac62ac39387b4cd3b9c8863b609b37a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:58:58.811994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.811994 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d246bf32-d57d-4ee6-a517-6886bedb5ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:58:58.813474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1316/2642] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:58:58 2022] DELETE /identity/v3/projects/ac62ac39387b4cd3b9c8863b609b37a9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:58.818318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74826c7-c676-416f-a5fd-0e7535a04db5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:58.818858 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74826c7-c676-416f-a5fd-0e7535a04db5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:58.818954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74826c7-c676-416f-a5fd-0e7535a04db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:58.839825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e74826c7-c676-416f-a5fd-0e7535a04db5 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:58.841040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e74826c7-c676-416f-a5fd-0e7535a04db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:58.901309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1327/2643] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:58.909193 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e595d78-1939-4519-bd44-b900778a78fa None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:58.909528 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e595d78-1939-4519-bd44-b900778a78fa None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:58.909808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e595d78-1939-4519-bd44-b900778a78fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:58.930122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0e595d78-1939-4519-bd44-b900778a78fa None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:58.931386 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0e595d78-1939-4519-bd44-b900778a78fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:58.939181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1317/2644] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:58.943393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74826c7-c676-416f-a5fd-0e7535a04db5 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:58.953704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74826c7-c676-416f-a5fd-0e7535a04db5 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:58.958632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:58.959500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:58.959783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:58.960054 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:58.960695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:58:58.960999 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:58.964734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:58.976729 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1328/2645] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:58:58.985961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e595d78-1939-4519-bd44-b900778a78fa None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:58.995097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e595d78-1939-4519-bd44-b900778a78fa None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:58.999844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:59.000408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.000613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.000995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.001497 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:59.003444 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:59.130677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1318/2646] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:58:58 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:59.135459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:59.145812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96efac7-6d85-410d-911f-5014730591fa admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:59.171788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:58:59.203051 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:59.203846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.204139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.204609 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.205316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:59.207834 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:59.312772 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1329/2647] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:58:59 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:59.316215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:59.327385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2540a-bc77-41ae-8ac4-36cc9e33da3a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:59.332071 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:59.332666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.332978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.333255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.333893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:59.335533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:59.346196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1319/2648] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:59.350434 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:59.360660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb05d-147b-4d00-8e11-aed85a32fe5d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:59.365283 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532adc7a-4fdf-4148-be66-318b13d448ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:59.365905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532adc7a-4fdf-4148-be66-318b13d448ac admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.366184 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532adc7a-4fdf-4148-be66-318b13d448ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.366456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532adc7a-4fdf-4148-be66-318b13d448ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.367095 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532adc7a-4fdf-4148-be66-318b13d448ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:59.369449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532adc7a-4fdf-4148-be66-318b13d448ac admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:59.380161 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1330/2649] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:58:59.384903 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:59.395453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbef71-bbc6-458a-81f4-35ff58ef527d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:59.400229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:59.400860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.401136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.401407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] PATH_INFO: `/v3/projects/26e70d399fcb4d3db03512a2780292d2/users/f713b2de11a34b2eb49a01849a316838/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.415506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e70d399fcb4d3db03512a2780292d2, user_id=f713b2de11a34b2eb49a01849a316838, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:59.418147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:59.500541 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1320/2650] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:58:59 2022] PUT /identity/v3/projects/26e70d399fcb4d3db03512a2780292d2/users/f713b2de11a34b2eb49a01849a316838/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:58:59.512574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad4436-9b02-4350-a2de-8e33fa613161 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.512860 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad4436-9b02-4350-a2de-8e33fa613161 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.513140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad4436-9b02-4350-a2de-8e33fa613161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.540553 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-96ad4436-9b02-4350-a2de-8e33fa613161 None None] MFA Rules not processed for user `f713b2de11a34b2eb49a01849a316838`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:58:59.541792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-96ad4436-9b02-4350-a2de-8e33fa613161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:58:59.605685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1331/2651] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:58:59.610369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:59.671895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf1cf-3991-4533-b2f9-4b37c27d8dd4 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:59.676538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:59.677158 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.677434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.677735 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.678368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:59.680303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:59.798922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1321/2652] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:58:59 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:59.802778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad4436-9b02-4350-a2de-8e33fa613161 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:59.814035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad4436-9b02-4350-a2de-8e33fa613161 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:58:59.868250 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:58:59.868850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:58:59.869217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:58:59.869391 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:58:59.870641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:58:59.872585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:58:59.976273 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1332/2653] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:58:59 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:58:59.987716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:58:59.998238 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e1b48-fcbc-47a2-ab4c-5268d8b7da26 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:00.002824 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:00.003483 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:00.003785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:00.004051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:00.004717 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:00.006309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:00.016853 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1322/2654] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:59:00.020942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:00.031363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a279f8-7526-4b34-962c-3178a85cd186 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:00.035949 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:00.036586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:00.036867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:00.037137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] PATH_INFO: `/v3/projects/c16f8027223247f7a6bf097af67e4526/users/bdf7af8bee79454ca418a235477cac37/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:00.051963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16f8027223247f7a6bf097af67e4526, user_id=bdf7af8bee79454ca418a235477cac37, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:00.054702 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:00.130590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1333/2655] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:59:00 2022] PUT /identity/v3/projects/c16f8027223247f7a6bf097af67e4526/users/bdf7af8bee79454ca418a235477cac37/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:00.134542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:00.145040 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60e50c-5c07-4f30-a096-15e51e06281a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:00.166436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:00.202412 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16c95e-1a4a-433d-a20c-d473faf9a96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:00.203013 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c95e-1a4a-433d-a20c-d473faf9a96b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:00.203321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c95e-1a4a-433d-a20c-d473faf9a96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:00.203597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c95e-1a4a-433d-a20c-d473faf9a96b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:00.204255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16c95e-1a4a-433d-a20c-d473faf9a96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:00.205851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16c95e-1a4a-433d-a20c-d473faf9a96b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:00.215992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1323/2656] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:59:00.220337 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:00.225736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:00.237713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90577797-522e-42ff-8234-31e1bf351943 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:00.237713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:00.237713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:00.237713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:00.238150 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] PATH_INFO: `/v3/projects/c16f8027223247f7a6bf097af67e4526/users/bdf7af8bee79454ca418a235477cac37/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:00.239479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16f8027223247f7a6bf097af67e4526, user_id=bdf7af8bee79454ca418a235477cac37, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:00.242105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:00.252704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1334/2657] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:59:00 2022] PUT /identity/v3/projects/c16f8027223247f7a6bf097af67e4526/users/bdf7af8bee79454ca418a235477cac37/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:00.268802 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e066f7-d081-4d50-8703-a5f99f73edf1 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:00.269089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e066f7-d081-4d50-8703-a5f99f73edf1 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:00.269367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e066f7-d081-4d50-8703-a5f99f73edf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:00.298099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-45e066f7-d081-4d50-8703-a5f99f73edf1 None None] MFA Rules not processed for user `bdf7af8bee79454ca418a235477cac37`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:00.299514 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-45e066f7-d081-4d50-8703-a5f99f73edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:00.366586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1324/2658] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:00.377334 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:00.378995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:00.435481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b7203-2ca8-4253-890d-3b80479227d2 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:00.439099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffe68b-7865-4094-b948-d0a8490b49c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:00.439716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffe68b-7865-4094-b948-d0a8490b49c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:00.440000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffe68b-7865-4094-b948-d0a8490b49c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:00.440262 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffe68b-7865-4094-b948-d0a8490b49c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:00.449535 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffe68b-7865-4094-b948-d0a8490b49c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:00.450953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffe68b-7865-4094-b948-d0a8490b49c1 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:00.460075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1335/2659] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:01.009123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e066f7-d081-4d50-8703-a5f99f73edf1 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:01.072126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e066f7-d081-4d50-8703-a5f99f73edf1 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:01.076637 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:01.077250 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:01.077522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:01.077788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] PATH_INFO: `/v3/users/f713b2de11a34b2eb49a01849a316838` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:01.078891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f713b2de11a34b2eb49a01849a316838)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:01.080808 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:01.235902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f713b2de11a34b2eb49a01849a316838'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:01.236924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:01.248741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f713b2de11a34b2eb49a01849a316838'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:01.255557 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f713b2de11a34b2eb49a01849a316838'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:01.256229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f713b2de11a34b2eb49a01849a316838'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:01.256830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f713b2de11a34b2eb49a01849a316838'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:01.335828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1325/2660] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:59:01 2022] DELETE /identity/v3/users/f713b2de11a34b2eb49a01849a316838 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:01.340583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:01.341046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:01.341170 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:01.360317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:01.361512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:01.419401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1336/2661] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:01.429099 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:01.431240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:01.491024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e113c-0db4-4249-98e0-588617c36371 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:01.492072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665d17-90b9-4980-b668-6479333655db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:01.492669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665d17-90b9-4980-b668-6479333655db service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:01.492948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665d17-90b9-4980-b668-6479333655db service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:01.493219 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665d17-90b9-4980-b668-6479333655db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:01.502163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49665d17-90b9-4980-b668-6479333655db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:01.503646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49665d17-90b9-4980-b668-6479333655db service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:01.513380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1326/2662] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:01.914193 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:01.915657 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:01.927539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebcdfd-41a7-4014-bed7-a6328648a5e0 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:01.932274 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:01.932900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:01.933179 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:01.933450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] PATH_INFO: `/v3/projects/26e70d399fcb4d3db03512a2780292d2` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:01.934567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e70d399fcb4d3db03512a2780292d2)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:01.936578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:02.044350 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e70d399fcb4d3db03512a2780292d2', 'request_id': 'req-458a43c3-cfd2-452c-9fbb-c90742cb70d3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.050023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e70d399fcb4d3db03512a2780292d2', 'request_id': 'req-458a43c3-cfd2-452c-9fbb-c90742cb70d3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.117023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e70d399fcb4d3db03512a2780292d2', 'request_id': 'req-458a43c3-cfd2-452c-9fbb-c90742cb70d3'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.128366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] The token cache is being invalidate because project 26e70d399fcb4d3db03512a2780292d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:59:02.128746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.129309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.130784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1337/2663] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:59:01 2022] DELETE /identity/v3/projects/26e70d399fcb4d3db03512a2780292d2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:59:02.135347 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665d17-90b9-4980-b668-6479333655db service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:02.145536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665d17-90b9-4980-b668-6479333655db service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:02.204438 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:02.205048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:02.205318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:02.205584 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] PATH_INFO: `/v3/users/bdf7af8bee79454ca418a235477cac37` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:02.206682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf7af8bee79454ca418a235477cac37)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:02.208634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:02.398119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf7af8bee79454ca418a235477cac37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.410537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf7af8bee79454ca418a235477cac37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.415629 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:02.418462 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf7af8bee79454ca418a235477cac37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.419330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf7af8bee79454ca418a235477cac37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.420024 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-68c49b71-f7dc-4fda-aa89-0d85c425fe18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf7af8bee79454ca418a235477cac37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:02.564285 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1327/2664] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:59:02 2022] DELETE /identity/v3/users/bdf7af8bee79454ca418a235477cac37 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:03.012782 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:03.014418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:03.028275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a43c3-cfd2-452c-9fbb-c90742cb70d3 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:03.042313 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:03.087466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:03.088085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.088370 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.088663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] PATH_INFO: `/v3/projects/c16f8027223247f7a6bf097af67e4526` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.089870 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16f8027223247f7a6bf097af67e4526)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:03.091868 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:03.215748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16f8027223247f7a6bf097af67e4526', 'request_id': 'req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:03.221541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16f8027223247f7a6bf097af67e4526', 'request_id': 'req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:03.319052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16f8027223247f7a6bf097af67e4526', 'request_id': 'req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:03.331885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] The token cache is being invalidate because project c16f8027223247f7a6bf097af67e4526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:59:03.332192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:03.332827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a331ff11-2fb8-45c0-94a4-d5cdbc8c2387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:03.334346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1338/2665] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:59:03 2022] DELETE /identity/v3/projects/c16f8027223247f7a6bf097af67e4526 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:03.339369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f26d6-4c32-4ac9-bb48-5a32407c1735 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.339854 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f26d6-4c32-4ac9-bb48-5a32407c1735 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.339969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f26d6-4c32-4ac9-bb48-5a32407c1735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.481561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-740f26d6-4c32-4ac9-bb48-5a32407c1735 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:03.482794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-740f26d6-4c32-4ac9-bb48-5a32407c1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:03.543277 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1328/2666] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:03.551046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c78d8-00c2-47a1-88fe-1108d5067762 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.551357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c78d8-00c2-47a1-88fe-1108d5067762 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.551625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c78d8-00c2-47a1-88fe-1108d5067762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.571953 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-cf2c78d8-00c2-47a1-88fe-1108d5067762 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:03.573152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cf2c78d8-00c2-47a1-88fe-1108d5067762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:03.580992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1339/2667] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:03.585043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f26d6-4c32-4ac9-bb48-5a32407c1735 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:03.594534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f26d6-4c32-4ac9-bb48-5a32407c1735 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:03.598980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:03.599597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.599880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.600150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.600789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:59:03.601090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:03.603190 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:03.614440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1329/2668] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:59:03.619106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c78d8-00c2-47a1-88fe-1108d5067762 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:03.628123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c78d8-00c2-47a1-88fe-1108d5067762 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:03.632627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:03.633206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.633475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.633789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.634461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:03.636372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:03.737035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1340/2669] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:59:03 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:59:03.749214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:03.759251 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bb662-3870-4190-87b2-3427995ee8dd admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:03.813964 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:03.814552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.814828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.815095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.815749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:03.817685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:03.890149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1330/2670] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:59:03 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:59:03.894294 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:03.906090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31bb6b-db15-4660-ae53-a50bb6c506f9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:03.910825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:03.911459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.911781 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.912048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.912687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:03.914266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:03.924939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1341/2671] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:59:03.928951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:03.939105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d225b56-cf38-443d-b31c-e26b8b02c9c7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:03.943839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca4ef-064f-4a9c-a35a-3e12342f490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:03.944467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca4ef-064f-4a9c-a35a-3e12342f490a admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.944777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca4ef-064f-4a9c-a35a-3e12342f490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.945064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca4ef-064f-4a9c-a35a-3e12342f490a admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.945695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca4ef-064f-4a9c-a35a-3e12342f490a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:03.947617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca4ef-064f-4a9c-a35a-3e12342f490a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:03.958522 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1331/2672] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:59:03.963020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:03.972940 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751d768-f5ad-41ea-a82a-e31075024c19 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:03.978181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:03.978815 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:03.979093 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:03.979466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] PATH_INFO: `/v3/projects/f8e2230f324349e9b3b658531d2b3d80/users/0ad88f691048467482d2555b166b9e43/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:03.993574 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e2230f324349e9b3b658531d2b3d80, user_id=0ad88f691048467482d2555b166b9e43, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:03.996266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:04.101538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1342/2673] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:59:03 2022] PUT /identity/v3/projects/f8e2230f324349e9b3b658531d2b3d80/users/0ad88f691048467482d2555b166b9e43/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:04.111799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1579-9137-49cb-aa4b-bf484eaf4f72 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:04.112149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1579-9137-49cb-aa4b-bf484eaf4f72 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:04.112439 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1579-9137-49cb-aa4b-bf484eaf4f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:04.140642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a84c1579-9137-49cb-aa4b-bf484eaf4f72 None None] MFA Rules not processed for user `0ad88f691048467482d2555b166b9e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:04.141760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a84c1579-9137-49cb-aa4b-bf484eaf4f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:04.181937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:04.203814 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1332/2674] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:04.216483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:04.218169 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:04.263430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:04.275646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b27bd-c60e-44f8-9d7a-0b9904935de4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:04.279324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52faef-fe7f-410c-8b19-943710fcda40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:04.279921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52faef-fe7f-410c-8b19-943710fcda40 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:04.280201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52faef-fe7f-410c-8b19-943710fcda40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:04.280474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52faef-fe7f-410c-8b19-943710fcda40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:04.288805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52faef-fe7f-410c-8b19-943710fcda40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:04.290276 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52faef-fe7f-410c-8b19-943710fcda40 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:04.298873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1343/2675] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:04.320799 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c1579-9137-49cb-aa4b-bf484eaf4f72 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:04.382608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c1579-9137-49cb-aa4b-bf484eaf4f72 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:04.387981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:04.388607 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:04.388883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:04.389150 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] PATH_INFO: `/v3/users/0ad88f691048467482d2555b166b9e43` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:04.390358 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad88f691048467482d2555b166b9e43)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:04.396268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:04.559744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad88f691048467482d2555b166b9e43'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:04.572362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad88f691048467482d2555b166b9e43'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:04.579111 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad88f691048467482d2555b166b9e43'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:04.579860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad88f691048467482d2555b166b9e43'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:04.580478 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad88f691048467482d2555b166b9e43'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:04.661769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1333/2676] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 16:59:04 2022] DELETE /identity/v3/users/0ad88f691048467482d2555b166b9e43 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:59:04.666289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:04.666575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:04.666851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:04.685899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:04.687085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:04.747685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1344/2677] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:04.757243 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:04.759367 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:04.815127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529baeb-4343-4fd5-ba3a-cbe81cfef864 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:04.818730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190eae0-7f0b-4119-b3f2-1d164aa7c183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:04.819345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190eae0-7f0b-4119-b3f2-1d164aa7c183 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:04.819628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190eae0-7f0b-4119-b3f2-1d164aa7c183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:04.819898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190eae0-7f0b-4119-b3f2-1d164aa7c183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:04.829307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190eae0-7f0b-4119-b3f2-1d164aa7c183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:04.830722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190eae0-7f0b-4119-b3f2-1d164aa7c183 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:04.840015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1334/2678] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:05.229585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:05.234462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:05.245633 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab22710-9310-44aa-8141-9475ace22d4d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:05.250885 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:05.251947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.252227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.252501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] PATH_INFO: `/v3/projects/f8e2230f324349e9b3b658531d2b3d80` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.253750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e2230f324349e9b3b658531d2b3d80)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:05.255794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:05.341967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e2230f324349e9b3b658531d2b3d80', 'request_id': 'req-0f324243-5773-4e4f-bf14-97e82e7a7b67'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:05.347502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e2230f324349e9b3b658531d2b3d80', 'request_id': 'req-0f324243-5773-4e4f-bf14-97e82e7a7b67'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:05.404594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e2230f324349e9b3b658531d2b3d80', 'request_id': 'req-0f324243-5773-4e4f-bf14-97e82e7a7b67'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:05.415970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] The token cache is being invalidate because project f8e2230f324349e9b3b658531d2b3d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:59:05.416277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:05.416901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-0f324243-5773-4e4f-bf14-97e82e7a7b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:59:05.418365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1345/2679] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 16:59:05 2022] DELETE /identity/v3/projects/f8e2230f324349e9b3b658531d2b3d80 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:05.423176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562139b0-12d9-425a-8870-6a6014882cbd None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.423772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562139b0-12d9-425a-8870-6a6014882cbd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.423772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562139b0-12d9-425a-8870-6a6014882cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.432574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:05.442934 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-562139b0-12d9-425a-8870-6a6014882cbd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:05.444174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-562139b0-12d9-425a-8870-6a6014882cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:05.502338 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1335/2680] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:05.510761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3733c4-3dfe-48bf-8045-f9e4f7e92b62 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.511046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3733c4-3dfe-48bf-8045-f9e4f7e92b62 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.511352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3733c4-3dfe-48bf-8045-f9e4f7e92b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.531174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ae3733c4-3dfe-48bf-8045-f9e4f7e92b62 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:05.532389 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ae3733c4-3dfe-48bf-8045-f9e4f7e92b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:05.540361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1346/2681] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:59:05.544364 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562139b0-12d9-425a-8870-6a6014882cbd None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:05.553650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562139b0-12d9-425a-8870-6a6014882cbd None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:05.558809 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:05.559431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.559709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.559978 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.560639 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:59:05.560917 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:05.562504 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:05.574744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1336/2682] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 16:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:59:05.578941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3733c4-3dfe-48bf-8045-f9e4f7e92b62 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:05.588317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3733c4-3dfe-48bf-8045-f9e4f7e92b62 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:05.593067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:05.593654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.593930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.594200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.594829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:05.596827 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:05.707491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1347/2683] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 16:59:05 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:59:05.711626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:05.721411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856fadf-d35f-49fe-ab19-ad660ab6bc1f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:05.776981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:05.783422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.783422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.783422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.783422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:05.783422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:05.888762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1337/2684] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 16:59:05 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:59:05.893209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:05.903644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ff516-67c5-41da-a248-08a6a96326c5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:05.908223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:05.908809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.909089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.909358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.909996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:05.911711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:05.922152 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1348/2685] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:59:05.926106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:05.936722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1e176-f206-42e8-b6e2-bfebf40fcfe0 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:05.941267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbc0e1-70ed-4dd3-a7f3-1c83e5447366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:05.941845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc0e1-70ed-4dd3-a7f3-1c83e5447366 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.942125 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc0e1-70ed-4dd3-a7f3-1c83e5447366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.942395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc0e1-70ed-4dd3-a7f3-1c83e5447366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.943026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc0e1-70ed-4dd3-a7f3-1c83e5447366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:05.944642 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc0e1-70ed-4dd3-a7f3-1c83e5447366 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:05.954773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1338/2686] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 16:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:59:05.958778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:05.970128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca72ecd-e547-4e04-98d0-8172e22ae067 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:05.974754 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:05.975431 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:05.975714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:05.975990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] PATH_INFO: `/v3/projects/68c5e9a4b5314f17b6352d810e00ef67/users/4a355b3d00e149d4b3d49ab24f672158/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:05.990821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c5e9a4b5314f17b6352d810e00ef67, user_id=4a355b3d00e149d4b3d49ab24f672158, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:05.993497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:06.090108 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1349/2687] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 16:59:05 2022] PUT /identity/v3/projects/68c5e9a4b5314f17b6352d810e00ef67/users/4a355b3d00e149d4b3d49ab24f672158/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:59:06.098972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5068-d4d4-4a80-9e60-03d01946ffcf None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:06.098972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5068-d4d4-4a80-9e60-03d01946ffcf None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:06.098972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5068-d4d4-4a80-9e60-03d01946ffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:06.116239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1bab5068-d4d4-4a80-9e60-03d01946ffcf None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:06.117448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1bab5068-d4d4-4a80-9e60-03d01946ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:06.176577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1339/2688] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:06.186255 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:06.187956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:06.194310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:06.247071 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71fbb6-8180-4f0e-9cbb-fd76cd2460f0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:06.250755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:06.251384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:06.251661 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:06.251930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:06.260709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:06.262123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:06.271608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1350/2689] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:07.516046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38718831-1656-4a1e-92a6-fcf6b98f3c53 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:07.516705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38718831-1656-4a1e-92a6-fcf6b98f3c53 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:07.516705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38718831-1656-4a1e-92a6-fcf6b98f3c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:07.543072 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:07.554581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-38718831-1656-4a1e-92a6-fcf6b98f3c53 None None] MFA Rules not processed for user `4a355b3d00e149d4b3d49ab24f672158`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:07.556122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-38718831-1656-4a1e-92a6-fcf6b98f3c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:07.634552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1340/2690] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:07.642919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:07.644728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:07.706579 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed22af-57f0-43f1-968b-937d5e7e41ca service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:07.710258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:07.710854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:07.711129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:07.711430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:07.720673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:07.722101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:07.731780 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1351/2691] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:10.486973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:10.493645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:10.493645 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:10.506574 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] MFA Rules not processed for user `4a355b3d00e149d4b3d49ab24f672158`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:10.507827 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:10.515189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1341/2692] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:10.757969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:10.759504 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:10.772468 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b400c90-432a-450c-a3fe-0106df9063f4 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:10.776471 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede96d6d-0a44-41c2-87e1-1173e24a2e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:10.777177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede96d6d-0a44-41c2-87e1-1173e24a2e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:10.777547 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede96d6d-0a44-41c2-87e1-1173e24a2e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:10.777911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede96d6d-0a44-41c2-87e1-1173e24a2e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:10.779669 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ede96d6d-0a44-41c2-87e1-1173e24a2e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:10.789287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede96d6d-0a44-41c2-87e1-1173e24a2e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:10.790708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede96d6d-0a44-41c2-87e1-1173e24a2e0e service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:10.799904 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1352/2693] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:12.186407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:12.188003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:12.260830 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2b872-ef85-4594-b8cd-d1bbd2c75e7b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:12.266303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:12.266902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:12.267208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:12.267488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:12.269500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:12.280811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:12.282372 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:12.292195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1342/2694] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:14.482682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:14.483279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:14.483400 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:14.503067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] MFA Rules not processed for user `f0c5ed608ce044c192d2710b27f2e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:14.504460 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:14.559541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1353/2695] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:14.880134 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:14.890086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522f3b2-e625-4255-be07-2e5c26d4a185 service placement] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:14.893879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:14.894454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:14.894725 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:14.894990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:14.896966 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:14.907308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:14.908737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:14.919239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1343/2696] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:16.319307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:16.320909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:16.368409 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:16.398550 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b102b-60da-4f49-9fa7-e209abc246e1 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:16.404801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:16.405423 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:16.405700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:16.405973 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:16.407750 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:16.420789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:16.422461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:16.433106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1354/2697] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:22.202654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:22.204936 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:22.223512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9349-8b85-4b1e-904d-ef45cae1abc3 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:22.229972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29c06b-79e6-47f6-87ab-eec26de24c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:22.231416 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29c06b-79e6-47f6-87ab-eec26de24c78 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:22.231782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29c06b-79e6-47f6-87ab-eec26de24c78 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:22.232110 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29c06b-79e6-47f6-87ab-eec26de24c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:22.233967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9a29c06b-79e6-47f6-87ab-eec26de24c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:22.248488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29c06b-79e6-47f6-87ab-eec26de24c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:22.250477 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29c06b-79e6-47f6-87ab-eec26de24c78 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:22.261957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1344/2698] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:22.788809 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:22.803084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c60424-42f2-4bc9-a9b6-e598cef95fcb service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:22.809306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d7286-3201-4eee-907f-9dbe1ff56cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:22.809907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7286-3201-4eee-907f-9dbe1ff56cff service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:22.810180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7286-3201-4eee-907f-9dbe1ff56cff service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:22.810558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7286-3201-4eee-907f-9dbe1ff56cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:22.812548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-dc6d7286-3201-4eee-907f-9dbe1ff56cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:22.827900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d7286-3201-4eee-907f-9dbe1ff56cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:22.829622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d7286-3201-4eee-907f-9dbe1ff56cff service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:22.843113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1355/2699] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 16:59:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:59:32.257363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=74 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:32.837593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=21 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:34.689951 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:34.690599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:34.690599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:34.709342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] MFA Rules not processed for user `4a355b3d00e149d4b3d49ab24f672158`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:34.710554 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:34.717523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1345/2700] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:44.704426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:59:57.896786 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db739-1db2-4a7d-92c9-6fa0393c4ac5 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:57.897299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db739-1db2-4a7d-92c9-6fa0393c4ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:57.897454 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db739-1db2-4a7d-92c9-6fa0393c4ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:57.949074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3c7db739-1db2-4a7d-92c9-6fa0393c4ac5 None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:59:57.950321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3c7db739-1db2-4a7d-92c9-6fa0393c4ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:58.019356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1356/2701] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 1 16:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:59:58.202929 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:59:58.204409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:59:58.306296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76a7ef-fbc6-4d98-b1ca-b68899cbe8f0 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:59:58.311850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:59:58.312492 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:59:58.312756 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:59:58.313032 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:59:58.322131 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:59:58.323784 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:59:58.333181 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1346/2702] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 16:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:00:08.016124 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=40 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:00:08.329363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=41 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:00:14.414595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2da9-827c-417f-b502-4e3842b49a2d None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:14.415107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2da9-827c-417f-b502-4e3842b49a2d None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:14.415107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2da9-827c-417f-b502-4e3842b49a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:14.434393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-108c2da9-827c-417f-b502-4e3842b49a2d None None] MFA Rules not processed for user `260ad63e7ce34605a3af952b328fae64`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:14.435616 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-108c2da9-827c-417f-b502-4e3842b49a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:14.442598 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1357/2703] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 1 17:00:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:00:14.455060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:14.465679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd4d8a-5031-4b95-8975-50af856ef2de service swift] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:14.470690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a6f6e719b6f49828fb866b4795e7108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:14.471325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:14.471603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:14.472627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:14.480879 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:14.482447 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:14.491486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1347/2704] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 1 17:00:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:00:17.387694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c2da9-827c-417f-b502-4e3842b49a2d None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:17.401764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c2da9-827c-417f-b502-4e3842b49a2d None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:17.407038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:17.407682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:17.407964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:17.408235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:17.410180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:17.422329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:17.424039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:17.435569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1358/2705] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:00:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:00:17.518318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:17.529526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3ae4-0e58-4e7d-a7f3-8b273708f406 service swift] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:17.534278 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:17.534999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:17.535353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:17.535686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] PATH_INFO: `/v3/users/4a355b3d00e149d4b3d49ab24f672158` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:17.536811 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a355b3d00e149d4b3d49ab24f672158)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:17.538743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:17.741773 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a355b3d00e149d4b3d49ab24f672158'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:17.753733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a355b3d00e149d4b3d49ab24f672158'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:17.761143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a355b3d00e149d4b3d49ab24f672158'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:17.761816 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a355b3d00e149d4b3d49ab24f672158'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:17.762426 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d5798fd4-3584-4b34-a5d4-11f071f04cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a355b3d00e149d4b3d49ab24f672158'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:17.835791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1348/2706] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:00:17 2022] DELETE /identity/v3/users/4a355b3d00e149d4b3d49ab24f672158 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:00:18.068246 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:18.081491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4451fa4-6aec-4b1e-b836-bb9e785da5e7 service placement] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:18.138056 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:18.138675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.138950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.139242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] PATH_INFO: `/v3/projects/68c5e9a4b5314f17b6352d810e00ef67` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.140342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c5e9a4b5314f17b6352d810e00ef67)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:18.142242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:18.276513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c5e9a4b5314f17b6352d810e00ef67', 'request_id': 'req-d8089192-656d-4bd6-bdd7-a732be1fe9d9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:18.281903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c5e9a4b5314f17b6352d810e00ef67', 'request_id': 'req-d8089192-656d-4bd6-bdd7-a732be1fe9d9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:18.357959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c5e9a4b5314f17b6352d810e00ef67', 'request_id': 'req-d8089192-656d-4bd6-bdd7-a732be1fe9d9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:18.369662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] The token cache is being invalidate because project 68c5e9a4b5314f17b6352d810e00ef67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:00:18.369922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:18.370539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-d8089192-656d-4bd6-bdd7-a732be1fe9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:18.372035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1359/2707] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:00:18 2022] DELETE /identity/v3/projects/68c5e9a4b5314f17b6352d810e00ef67 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:00:18.376861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8085-f4db-46d2-85e0-a3a6c74ea027 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.377151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8085-f4db-46d2-85e0-a3a6c74ea027 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.377430 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8085-f4db-46d2-85e0-a3a6c74ea027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.398615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ea6d8085-f4db-46d2-85e0-a3a6c74ea027 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:18.399882 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ea6d8085-f4db-46d2-85e0-a3a6c74ea027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:18.458140 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1349/2708] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:00:18.466207 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460eee-fa4f-4793-b4d8-de531900f2e2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.466704 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460eee-fa4f-4793-b4d8-de531900f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.466822 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460eee-fa4f-4793-b4d8-de531900f2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.486695 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e5460eee-fa4f-4793-b4d8-de531900f2e2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:18.487926 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e5460eee-fa4f-4793-b4d8-de531900f2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:18.495737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1360/2709] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:00:18.502270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8085-f4db-46d2-85e0-a3a6c74ea027 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:18.511877 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8085-f4db-46d2-85e0-a3a6c74ea027 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:18.516473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:18.517129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.517405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.517678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.518340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:00:18.519137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:18.520519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:18.532216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1350/2710] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:00:18.536428 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5460eee-fa4f-4793-b4d8-de531900f2e2 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:18.546472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5460eee-fa4f-4793-b4d8-de531900f2e2 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:18.551109 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:18.551734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.552042 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.552314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.552952 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:18.554839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:18.621685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1361/2711] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:00:18 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:00:18.625731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:18.635540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133095a-562d-4f2a-bf50-fa3f7983ef9c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:18.678673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:00:18.691102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:18.691723 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.692000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.692270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.692899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:18.695067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:18.776079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1351/2712] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:00:18 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:00:18.780272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:18.790568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60627a54-6dec-4a0e-81f2-732533e3668e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:18.795249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:18.795832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.796107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.796375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.797000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:18.798608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:18.808610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1362/2713] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:00:18.812351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:18.823113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e8cc-1491-4862-a208-02c4e3ff3917 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:18.827701 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca2e06-3683-4500-9ebe-69c9febff6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:18.828283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca2e06-3683-4500-9ebe-69c9febff6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.828559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca2e06-3683-4500-9ebe-69c9febff6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.828826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca2e06-3683-4500-9ebe-69c9febff6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.829456 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca2e06-3683-4500-9ebe-69c9febff6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:18.831015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca2e06-3683-4500-9ebe-69c9febff6b4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:18.841909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1352/2714] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:00:18.845813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:18.855348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b00a9-fc30-4e15-8ff6-faf782b683c6 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:18.859842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:18.860464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.860737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.861003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] PATH_INFO: `/v3/projects/ddaa0e2fb69c459686721dad91d869d4/users/7d5962e2f6334b2ab1ab96c2324022b6/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.874921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddaa0e2fb69c459686721dad91d869d4, user_id=7d5962e2f6334b2ab1ab96c2324022b6, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:18.877492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:18.955925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1363/2715] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:00:18 2022] PUT /identity/v3/projects/ddaa0e2fb69c459686721dad91d869d4/users/7d5962e2f6334b2ab1ab96c2324022b6/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:00:18.967023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a68a-9e68-453a-8bd9-57681862cb39 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:18.967340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a68a-9e68-453a-8bd9-57681862cb39 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:18.967616 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a68a-9e68-453a-8bd9-57681862cb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:18.995591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8f66a68a-9e68-453a-8bd9-57681862cb39 None None] MFA Rules not processed for user `7d5962e2f6334b2ab1ab96c2324022b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:18.996797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8f66a68a-9e68-453a-8bd9-57681862cb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:19.058764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1353/2716] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:00:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:00:19.070040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:19.071736 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:19.081496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:00:19.150258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4df45f-3491-4f4b-bea7-f15af8232e14 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:19.153842 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89254-038d-48c4-bda8-eae23a325e2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2b14464bea4a81b2995c6f9289ec73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:19.154532 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89254-038d-48c4-bda8-eae23a325e2e service glance] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:19.154816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89254-038d-48c4-bda8-eae23a325e2e service glance] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:19.155088 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89254-038d-48c4-bda8-eae23a325e2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:19.163959 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89254-038d-48c4-bda8-eae23a325e2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:19.165378 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89254-038d-48c4-bda8-eae23a325e2e service glance] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:19.174164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1364/2717] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:00:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:00:29.055938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:00:29.175229 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=32 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:00:58.267558 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66a68a-9e68-453a-8bd9-57681862cb39 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:58.328097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66a68a-9e68-453a-8bd9-57681862cb39 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:58.332553 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:58.333169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:58.333445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:58.333714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] PATH_INFO: `/v3/users/7d5962e2f6334b2ab1ab96c2324022b6` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:58.334815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5962e2f6334b2ab1ab96c2324022b6)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:58.336760 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:58.528838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5962e2f6334b2ab1ab96c2324022b6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:58.540595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5962e2f6334b2ab1ab96c2324022b6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:58.547379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5962e2f6334b2ab1ab96c2324022b6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:58.548015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5962e2f6334b2ab1ab96c2324022b6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:58.548627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5962e2f6334b2ab1ab96c2324022b6'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:58.617891 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1354/2718] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:00:58 2022] DELETE /identity/v3/users/7d5962e2f6334b2ab1ab96c2324022b6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:00:58.623052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:58.623584 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:58.623692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:58.642645 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:58.644146 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:58.703023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1365/2719] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:00:58.712657 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:58.714161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:58.771271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6253cc-a22a-43a6-b5ff-cf5b4c3f0fd4 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:58.774884 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde18b86-75f3-4a72-8402-05d8c5ae9247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:58.775507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18b86-75f3-4a72-8402-05d8c5ae9247 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:58.775834 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18b86-75f3-4a72-8402-05d8c5ae9247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:58.776104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18b86-75f3-4a72-8402-05d8c5ae9247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:58.784941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde18b86-75f3-4a72-8402-05d8c5ae9247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:58.786343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde18b86-75f3-4a72-8402-05d8c5ae9247 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:58.796060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1355/2720] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:00:59.182072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:59.183577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:59.195463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103e9a9-fd2a-42a2-bea3-ce7755a69609 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:59.200318 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:59.200954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.201231 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.201507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] PATH_INFO: `/v3/projects/ddaa0e2fb69c459686721dad91d869d4` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.202638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddaa0e2fb69c459686721dad91d869d4)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:59.204685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:59.288941 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddaa0e2fb69c459686721dad91d869d4', 'request_id': 'req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:59.294968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddaa0e2fb69c459686721dad91d869d4', 'request_id': 'req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:59.363050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddaa0e2fb69c459686721dad91d869d4', 'request_id': 'req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:59.374167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] The token cache is being invalidate because project ddaa0e2fb69c459686721dad91d869d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:00:59.374455 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:59.375082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3a734cef-4fe2-4f88-ba14-a3e5ac1db4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:00:59.376577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1366/2721] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:00:59 2022] DELETE /identity/v3/projects/ddaa0e2fb69c459686721dad91d869d4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:00:59.381451 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06474-e0e1-42d0-8718-a609edf7666f None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.381922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06474-e0e1-42d0-8718-a609edf7666f None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.382025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06474-e0e1-42d0-8718-a609edf7666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.401991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-78d06474-e0e1-42d0-8718-a609edf7666f None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:59.403214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-78d06474-e0e1-42d0-8718-a609edf7666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:59.420107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:00:59.460174 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1356/2722] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:00:59.468556 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f50ad9-9844-4901-8a18-d04509c1582e None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.468839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f50ad9-9844-4901-8a18-d04509c1582e None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.469111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f50ad9-9844-4901-8a18-d04509c1582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.489349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-b7f50ad9-9844-4901-8a18-d04509c1582e None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:59.490551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-b7f50ad9-9844-4901-8a18-d04509c1582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:00:59.498499 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1367/2723] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:00:59.502878 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06474-e0e1-42d0-8718-a609edf7666f None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:59.512561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06474-e0e1-42d0-8718-a609edf7666f None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:59.517736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:59.518351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.518623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.519145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.519828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:00:59.520129 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:59.521715 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:59.533926 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1357/2724] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:00:59.538050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f50ad9-9844-4901-8a18-d04509c1582e None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:59.547887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f50ad9-9844-4901-8a18-d04509c1582e None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:59.552492 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:59.553075 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.553379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.553654 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.554278 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:59.556243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:59.632599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1368/2725] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:00:59 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:00:59.637192 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:59.647461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0ca32-bec2-479b-87b2-a59a1437cb9a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:59.703428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:59.704023 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.704300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.704573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.705206 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:59.707118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:59.780654 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1358/2726] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:00:59 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:00:59.784839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:59.795235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855168f4-077e-43ff-9f41-7b18ef5d4bd5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:59.799911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:59.800438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.800755 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.801028 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.801666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:59.803277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:59.813052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1369/2727] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:00:59.816761 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:59.827073 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66b25-d070-4cfe-8c72-f6de1a423b05 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:59.831591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f983e-4e6d-4a27-a2c9-9132cd510d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:59.832169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f983e-4e6d-4a27-a2c9-9132cd510d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.832441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f983e-4e6d-4a27-a2c9-9132cd510d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.832709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f983e-4e6d-4a27-a2c9-9132cd510d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.833333 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f983e-4e6d-4a27-a2c9-9132cd510d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:59.834922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f983e-4e6d-4a27-a2c9-9132cd510d47 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:59.846627 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1359/2728] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:00:59.850641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:00:59.860560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e8a3-cbb1-4405-b701-6902f534c156 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:00:59.865160 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:00:59.865789 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.866065 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.866357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] PATH_INFO: `/v3/projects/00e9863b65e545aca222230a2881d311/users/f433dcafdbdd4f6bb4742dec3994c4a9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.880402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e9863b65e545aca222230a2881d311, user_id=f433dcafdbdd4f6bb4742dec3994c4a9, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:00:59.883035 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:00:59.938377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1370/2729] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:00:59 2022] PUT /identity/v3/projects/00e9863b65e545aca222230a2881d311/users/f433dcafdbdd4f6bb4742dec3994c4a9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:00:59.943457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a430-aef3-45b8-be77-8d4ae7234235 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:00:59.943751 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a430-aef3-45b8-be77-8d4ae7234235 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:00:59.943997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a430-aef3-45b8-be77-8d4ae7234235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:00:59.963763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-ae33a430-aef3-45b8-be77-8d4ae7234235 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:00:59.964961 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ae33a430-aef3-45b8-be77-8d4ae7234235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:00.022362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1360/2730] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:01:00.033801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:01:00.035530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:00.056798 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:01:00.091734 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00b507-32ce-4fb8-acc3-e1ad7de45694 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:01:00.095414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:01:00.096010 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:00.096289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:00.096560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:00.106047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:01:00.107490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:01:00.116678 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1371/2731] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:01:01.405151 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922421-06cb-420d-97f3-de05983e9340 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:01.405737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922421-06cb-420d-97f3-de05983e9340 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:01.405737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922421-06cb-420d-97f3-de05983e9340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:01.434123 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-72922421-06cb-420d-97f3-de05983e9340 None None] MFA Rules not processed for user `f433dcafdbdd4f6bb4742dec3994c4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:01:01.435455 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-72922421-06cb-420d-97f3-de05983e9340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:01.452376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:01:01.502915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1361/2732] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:01:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:01:01.513686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:01:01.515134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:01.572289 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351a5df-4180-4f6b-a0f1-7fece27ce1b3 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:01:01.575903 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:01:01.576497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:01.576776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:01.577046 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:01.585386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:01:01.586856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:01:01.596300 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1372/2733] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:01:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:01:04.308595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0564b-d45e-4241-9d14-d6622100a4fd None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:04.309146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0564b-d45e-4241-9d14-d6622100a4fd None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:04.309146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0564b-d45e-4241-9d14-d6622100a4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:04.327979 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-09f0564b-d45e-4241-9d14-d6622100a4fd None None] MFA Rules not processed for user `f433dcafdbdd4f6bb4742dec3994c4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:01:04.329179 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-09f0564b-d45e-4241-9d14-d6622100a4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:04.335972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1362/2734] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:01:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:01:11.592277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=43 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:01:14.322510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=22 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:01:21.309594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:01:21.311062 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:21.388211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508e61-6dd6-4974-80f2-ac1177260a72 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:01:21.393330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973a8b-b9a2-47c5-8567-3f1fa3d37f28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:01:21.394317 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973a8b-b9a2-47c5-8567-3f1fa3d37f28 service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:21.394596 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973a8b-b9a2-47c5-8567-3f1fa3d37f28 service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:21.394866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973a8b-b9a2-47c5-8567-3f1fa3d37f28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:21.396691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-97973a8b-b9a2-47c5-8567-3f1fa3d37f28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:21.410214 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973a8b-b9a2-47c5-8567-3f1fa3d37f28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:01:21.411857 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973a8b-b9a2-47c5-8567-3f1fa3d37f28 service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:01:21.422753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1373/2735] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:01:26.929840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:26.935774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:26.935774 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:26.949748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] MFA Rules not processed for user `f0c5ed608ce044c192d2710b27f2e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:01:26.950838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:27.002739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1363/2736] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:01:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:01:31.418859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=32 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:01:36.995897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=25 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:01:47.529082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7fb81-fb0e-476b-b029-5f3fec510fa2 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:47.529662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7fb81-fb0e-476b-b029-5f3fec510fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:47.529662 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7fb81-fb0e-476b-b029-5f3fec510fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:47.549765 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f1d7fb81-fb0e-476b-b029-5f3fec510fa2 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:01:47.551135 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f1d7fb81-fb0e-476b-b029-5f3fec510fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:47.558957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1374/2737] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:01:47.581636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:01:47.583920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:47.658940 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd09778-d397-4a19-9f83-35ab9bb40c34 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:01:47.664414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:01:47.665010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:47.665291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:47.665562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:47.674217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:01:47.675846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:01:47.685130 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1364/2738] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:01:52.863113 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2ebf-8e9a-4562-916b-c66b2ab511e0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:52.863705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2ebf-8e9a-4562-916b-c66b2ab511e0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:52.863705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2ebf-8e9a-4562-916b-c66b2ab511e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:52.882874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-cfea2ebf-8e9a-4562-916b-c66b2ab511e0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:01:52.884098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cfea2ebf-8e9a-4562-916b-c66b2ab511e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:52.892447 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1375/2739] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:01:52.915239 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:01:52.916628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:52.931209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8b3bc-588f-4154-9dee-1860915b95c1 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:01:52.937003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:01:52.937611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:52.937972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:52.938263 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:52.946543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:01:52.948143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:01:52.957933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1365/2740] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:01:57.253994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:57.254520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:57.254520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:57.273835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:01:57.277543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:57.283356 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1376/2741] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:01:57.304885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:01:57.316596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8d3c-fea3-4018-8f82-851e92ee6ff7 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:01:57.321983 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de9750-2e45-4e0e-9d5c-1eca99945c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:01:57.329018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de9750-2e45-4e0e-9d5c-1eca99945c7b service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:57.329018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de9750-2e45-4e0e-9d5c-1eca99945c7b service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:57.329018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de9750-2e45-4e0e-9d5c-1eca99945c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:57.332876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de9750-2e45-4e0e-9d5c-1eca99945c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:01:57.334436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de9750-2e45-4e0e-9d5c-1eca99945c7b service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:01:57.344273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1366/2742] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:01:57.361156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:01:57.362575 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:57.375206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a554e-9b07-49de-9929-7282d4f646ab None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:01:57.380462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:01:57.380462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:01:57.380462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:01:57.380462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:01:57.382302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:01:57.442602 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:01:57.444256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:01:57.453874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1377/2743] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:02:02.286676 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34872164-b27f-469f-95db-783be7dc1dfb None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:02.287237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34872164-b27f-469f-95db-783be7dc1dfb None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:02.287237 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34872164-b27f-469f-95db-783be7dc1dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:02.308888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-34872164-b27f-469f-95db-783be7dc1dfb None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:02.313002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-34872164-b27f-469f-95db-783be7dc1dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:02.318740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1367/2744] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:02.342722 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:02.357176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd509f7-9cf1-4ae5-9d7f-ace76242ea22 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:02.363653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a2044-b062-4c61-bcef-550b8c6a320e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:02.364299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a2044-b062-4c61-bcef-550b8c6a320e service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:02.364581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a2044-b062-4c61-bcef-550b8c6a320e service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:02.364852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a2044-b062-4c61-bcef-550b8c6a320e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:02.373943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a2044-b062-4c61-bcef-550b8c6a320e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:02.375753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a2044-b062-4c61-bcef-550b8c6a320e service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:02.387744 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1378/2745] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:06.107047 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34872164-b27f-469f-95db-783be7dc1dfb None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:06.117448 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34872164-b27f-469f-95db-783be7dc1dfb None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:06.121076 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:06.121658 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:06.121937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:06.122209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:06.123968 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:06.136321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:06.138669 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:06.147624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1368/2746] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:06.520430 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58b47-09e1-4ed7-b102-e6c70a672f07 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:06.521053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58b47-09e1-4ed7-b102-e6c70a672f07 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:06.521053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58b47-09e1-4ed7-b102-e6c70a672f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:06.540687 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-63c58b47-09e1-4ed7-b102-e6c70a672f07 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:06.541897 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-63c58b47-09e1-4ed7-b102-e6c70a672f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:06.549930 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1379/2747] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:06.570408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:06.583563 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda874ed-2f85-4bed-b48d-06f2747ce14b service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:06.588984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377115d-1f51-41ab-97b1-691d91ef44fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:06.589572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377115d-1f51-41ab-97b1-691d91ef44fd service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:06.589848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377115d-1f51-41ab-97b1-691d91ef44fd service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:06.590121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377115d-1f51-41ab-97b1-691d91ef44fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:06.598411 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377115d-1f51-41ab-97b1-691d91ef44fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:06.600031 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377115d-1f51-41ab-97b1-691d91ef44fd service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:06.609601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1369/2748] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:09.606924 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58b47-09e1-4ed7-b102-e6c70a672f07 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:09.619084 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58b47-09e1-4ed7-b102-e6c70a672f07 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:09.624099 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:09.624696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:09.625003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:09.625296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:09.627020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:09.638618 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:09.650080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:09.659204 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1380/2749] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:10.817070 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:10.817598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:10.817598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:10.848440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:10.849678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:10.857683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1370/2750] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:10.879495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:10.892239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac424a-5534-40fd-805c-8bb4008669f6 service placement] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:10.898420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:10.899140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:10.899522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:10.899862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:10.908516 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:10.910089 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:10.919653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1381/2751] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:02:13.441944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:13.443795 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:13.460750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1ff3e-6e8f-4139-83de-a2d0e756d67b None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:13.466105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:13.466727 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:13.467010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:13.467360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] PATH_INFO: `/v3/users/066b4dc9224344a582800031a954ceac` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:13.468486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066b4dc9224344a582800031a954ceac)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:13.470944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:13.672740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066b4dc9224344a582800031a954ceac'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:13.684843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066b4dc9224344a582800031a954ceac'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:13.691865 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066b4dc9224344a582800031a954ceac'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:13.692544 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066b4dc9224344a582800031a954ceac'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:13.693160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066b4dc9224344a582800031a954ceac'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:13.694836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:02:13.805433 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1371/2752] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:02:13 2022] DELETE /identity/v3/users/066b4dc9224344a582800031a954ceac => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:02:14.049037 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:14.052948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=59 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:02:14.058840 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79a8d-3d51-4232-ba8e-9a8d6fbc33a4 service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:14.117784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:14.118411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:14.118719 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:14.119047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] PATH_INFO: `/v3/projects/158737870bb049b6a31e62b14b45c8ea` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:14.120241 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=158737870bb049b6a31e62b14b45c8ea)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:14.122200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:14.240841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158737870bb049b6a31e62b14b45c8ea', 'request_id': 'req-a7964d1f-76c2-4147-9d63-1132e319f212'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.246591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158737870bb049b6a31e62b14b45c8ea', 'request_id': 'req-a7964d1f-76c2-4147-9d63-1132e319f212'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.325708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158737870bb049b6a31e62b14b45c8ea', 'request_id': 'req-a7964d1f-76c2-4147-9d63-1132e319f212'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.337716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] The token cache is being invalidate because project 158737870bb049b6a31e62b14b45c8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:02:14.338002 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.338634 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.340178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1382/2753] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:02:14 2022] DELETE /identity/v3/projects/158737870bb049b6a31e62b14b45c8ea => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:02:14.344847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:14.346258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:14.359368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf156-f996-41d8-b1ef-7b87908790c6 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:14.416963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:14.417614 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:14.417904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:14.418225 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] PATH_INFO: `/v3/users/796c44429b5d4d41a8c51498e40ef8f1` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:14.419390 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] RBAC: Authorizing `identity:delete_user(user_id=796c44429b5d4d41a8c51498e40ef8f1)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:14.421318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:14.609082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796c44429b5d4d41a8c51498e40ef8f1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.621340 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796c44429b5d4d41a8c51498e40ef8f1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.628779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796c44429b5d4d41a8c51498e40ef8f1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.632280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796c44429b5d4d41a8c51498e40ef8f1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.632280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796c44429b5d4d41a8c51498e40ef8f1'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:14.722449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1372/2754] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:02:14 2022] DELETE /identity/v3/users/796c44429b5d4d41a8c51498e40ef8f1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:02:14.969766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:14.969766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:14.986227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964d1f-76c2-4147-9d63-1132e319f212 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:15.050213 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:15.050919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:15.051222 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:15.051490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] PATH_INFO: `/v3/projects/a838e7a39439480eb68b781b7628fbb8` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:15.052617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a838e7a39439480eb68b781b7628fbb8)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:15.054591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:15.205466 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:02:15.214899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a838e7a39439480eb68b781b7628fbb8', 'request_id': 'req-21765b92-6017-40db-94cc-b5723602af13'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:15.220947 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a838e7a39439480eb68b781b7628fbb8', 'request_id': 'req-21765b92-6017-40db-94cc-b5723602af13'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:15.333813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a838e7a39439480eb68b781b7628fbb8', 'request_id': 'req-21765b92-6017-40db-94cc-b5723602af13'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:15.347248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] The token cache is being invalidate because project a838e7a39439480eb68b781b7628fbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:02:15.348418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:15.349139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:02:15.350632 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1383/2755] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:02:14 2022] DELETE /identity/v3/projects/a838e7a39439480eb68b781b7628fbb8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:02:21.471976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:21.473437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:21.530373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b6db-12cf-4564-9b22-7ea6fc72178a admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:21.553157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:02:21.577241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36590-e91d-4381-b171-432f442aa104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:21.577844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36590-e91d-4381-b171-432f442aa104 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:21.578775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36590-e91d-4381-b171-432f442aa104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:21.579049 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36590-e91d-4381-b171-432f442aa104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:21.580823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-25f36590-e91d-4381-b171-432f442aa104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:21.649591 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36590-e91d-4381-b171-432f442aa104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:21.651029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36590-e91d-4381-b171-432f442aa104 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:21.662082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1373/2756] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:23.959041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:23.960630 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:23.972954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21765b92-6017-40db-94cc-b5723602af13 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:23.976529 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70fe8c-1527-4cbc-9062-fdec36be18ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:23.977879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70fe8c-1527-4cbc-9062-fdec36be18ab service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:23.977879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70fe8c-1527-4cbc-9062-fdec36be18ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:23.977879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70fe8c-1527-4cbc-9062-fdec36be18ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:23.979601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-8a70fe8c-1527-4cbc-9062-fdec36be18ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:23.994303 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70fe8c-1527-4cbc-9062-fdec36be18ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:23.996033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70fe8c-1527-4cbc-9062-fdec36be18ab service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:24.008948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1384/2757] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:29.358683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:29.359215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:29.359342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:29.377849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] MFA Rules not processed for user `f433dcafdbdd4f6bb4742dec3994c4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:29.379126 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:29.433120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1374/2758] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:02:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:34.003813 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=5,keystone:SELECT=17,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:02:39.426603 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=67 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:02:46.689286 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4ae4b-11ae-4dfc-b30a-ef672eb118a3 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:46.689883 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4ae4b-11ae-4dfc-b30a-ef672eb118a3 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:46.690009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4ae4b-11ae-4dfc-b30a-ef672eb118a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:46.710219 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5ac4ae4b-11ae-4dfc-b30a-ef672eb118a3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:46.711444 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5ac4ae4b-11ae-4dfc-b30a-ef672eb118a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:46.769674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1385/2759] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:46.792034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:46.793518 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:46.809375 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a517a-d7ac-4152-8cce-dc7fa2961a95 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:46.815704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:46.816314 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:46.816581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:46.816842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:46.824765 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:46.826322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:46.835485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1375/2760] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:51.154538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2e76-1b59-45a3-99f1-d32ef98fb7f0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:51.155181 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2e76-1b59-45a3-99f1-d32ef98fb7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:51.155306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2e76-1b59-45a3-99f1-d32ef98fb7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:51.175896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-ba2c2e76-1b59-45a3-99f1-d32ef98fb7f0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:51.177987 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ba2c2e76-1b59-45a3-99f1-d32ef98fb7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:51.185259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1386/2761] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:51.207273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:51.208714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:51.223067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be15a4-407c-4138-a8e3-26ae6eabb6b7 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:51.228876 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:51.229465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:51.229744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:51.230015 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:51.238668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:51.240259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:51.249539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1376/2762] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:55.113510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d2f3b-641f-49fa-af2b-3af5bf0f4004 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:55.114014 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d2f3b-641f-49fa-af2b-3af5bf0f4004 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:55.114129 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d2f3b-641f-49fa-af2b-3af5bf0f4004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:55.133751 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1f7d2f3b-641f-49fa-af2b-3af5bf0f4004 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:55.134946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1f7d2f3b-641f-49fa-af2b-3af5bf0f4004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:55.142799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1387/2763] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:55.165998 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:55.177353 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5f0e-c22a-4504-9ebd-bc1fb283e87c service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:55.182912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:55.183535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:55.183832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:55.184090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:55.192874 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:55.194431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:55.203763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1377/2764] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:02:59.381886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27e86-d2ab-4d10-b5c2-5893e6432416 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:59.382396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27e86-d2ab-4d10-b5c2-5893e6432416 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:59.382513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27e86-d2ab-4d10-b5c2-5893e6432416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:59.402260 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-76d27e86-d2ab-4d10-b5c2-5893e6432416 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:02:59.403495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-76d27e86-d2ab-4d10-b5c2-5893e6432416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:02:59.411972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1388/2765] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:02:59.435791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:02:59.447107 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b3bc-6d84-412f-842f-6ec16020a49d service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:02:59.452564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:02:59.453147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:02:59.453425 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:02:59.453695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:02:59.462189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:02:59.463794 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:02:59.473559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1378/2766] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:03:03.627490 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9806f2-7c3a-4572-ae0f-bdfd2c0a4b15 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:03:03.628020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9806f2-7c3a-4572-ae0f-bdfd2c0a4b15 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:03:03.628020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9806f2-7c3a-4572-ae0f-bdfd2c0a4b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:03:03.647382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-bb9806f2-7c3a-4572-ae0f-bdfd2c0a4b15 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:03:03.648593 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bb9806f2-7c3a-4572-ae0f-bdfd2c0a4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:03:03.656614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1389/2767] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 1 17:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:03:03.686930 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:03:03.698051 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1423-439b-4bc6-8ad3-20156b9aa2dd service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:03:03.703662 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3d40e-3a55-4b3b-95a6-cdb7019c8e62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:03:03.704232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3d40e-3a55-4b3b-95a6-cdb7019c8e62 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:03:03.704503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3d40e-3a55-4b3b-95a6-cdb7019c8e62 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:03:03.704768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3d40e-3a55-4b3b-95a6-cdb7019c8e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:03:03.713888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3d40e-3a55-4b3b-95a6-cdb7019c8e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:03:03.715476 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3d40e-3a55-4b3b-95a6-cdb7019c8e62 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:03:03.725216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1379/2768] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:03:10.748558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9806f2-7c3a-4572-ae0f-bdfd2c0a4b15 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:03:10.761844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9806f2-7c3a-4572-ae0f-bdfd2c0a4b15 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:03:10.767538 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:03:10.768137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:03:10.768416 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:03:10.768686 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:03:10.770693 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:03:10.829257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:03:10.830881 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:03:10.839915 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1390/2769] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:03:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:03:13.720596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=30 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:03:20.835863 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=67 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:03:29.920226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:03:29.920738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:03:29.920850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:03:29.939479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] MFA Rules not processed for user `f0c5ed608ce044c192d2710b27f2e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:03:29.940692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:03:29.947602 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1380/2770] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:03:33.925368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:03:33.926799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:03:33.939117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1622-7661-4475-b54e-c748ec8fb2d7 service nova] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:03:33.942866 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:03:33.943551 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:03:33.943832 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:03:33.944106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:03:33.945928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:03:33.955465 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:03:33.956874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:03:33.965142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1391/2771] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:03:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:03:39.934461 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:03:41.182787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:03:41.184292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:03:41.198117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e46e2e-b994-4f62-ad66-8f2ffdea0dbe None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:03:41.204779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:03:41.204779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:03:41.204779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:03:41.204779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] PATH_INFO: `/v3/users/f433dcafdbdd4f6bb4742dec3994c4a9` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:03:41.205851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f433dcafdbdd4f6bb4742dec3994c4a9)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:03:41.206924 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:03:41.414838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f433dcafdbdd4f6bb4742dec3994c4a9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:41.426537 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f433dcafdbdd4f6bb4742dec3994c4a9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:41.433288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f433dcafdbdd4f6bb4742dec3994c4a9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:41.433986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f433dcafdbdd4f6bb4742dec3994c4a9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:41.434585 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f433dcafdbdd4f6bb4742dec3994c4a9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:41.508789 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1381/2772] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:03:41 2022] DELETE /identity/v3/users/f433dcafdbdd4f6bb4742dec3994c4a9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:03:41.840018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:03:41.851797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b97648-a5fc-40d5-baae-f54206c6db7d service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:03:41.908332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:03:41.908957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:03:41.909237 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:03:41.909507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] PATH_INFO: `/v3/projects/00e9863b65e545aca222230a2881d311` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:03:41.910635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e9863b65e545aca222230a2881d311)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:03:41.912573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:03:42.053622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e9863b65e545aca222230a2881d311', 'request_id': 'req-a86a00f4-6a7d-4a82-9814-c04b4ade9642'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:42.059932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e9863b65e545aca222230a2881d311', 'request_id': 'req-a86a00f4-6a7d-4a82-9814-c04b4ade9642'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:42.120873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e9863b65e545aca222230a2881d311', 'request_id': 'req-a86a00f4-6a7d-4a82-9814-c04b4ade9642'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:42.134111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] The token cache is being invalidate because project 00e9863b65e545aca222230a2881d311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:03:42.138510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:42.138510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:03:42.138510 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1392/2773] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:03:41 2022] DELETE /identity/v3/projects/00e9863b65e545aca222230a2881d311 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:03:51.505336 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:03:52.130957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:12.915143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:12.916683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:12.999084 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056403eb-96b4-404d-97c2-5303fff9a6ba admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:13.073113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1276878b8f0541398e54be24543abd85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:13.073818 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:13.074102 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:13.074376 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:13.076242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:13.092801 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:13.094769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:13.108757 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1382/2774] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:19.248703 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:19.250107 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:19.334121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a00f4-6a7d-4a82-9814-c04b4ade9642 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:19.337715 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:19.338309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:19.338581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:19.338851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:19.340571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:19.441126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:19.442476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:19.461909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1393/2775] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:23.091914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:23.093831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:23.141729 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b4d6b-0ab3-4df8-8aa2-fecb1bdaf030 service nova] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:23.146524 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:23.149519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:23.149519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:23.149519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] PATH_INFO: `/v3/users/f0c5ed608ce044c192d2710b27f2e8bf` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:23.149519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c5ed608ce044c192d2710b27f2e8bf)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:23.150730 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:23.334822 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:23.336443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c5ed608ce044c192d2710b27f2e8bf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.348919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c5ed608ce044c192d2710b27f2e8bf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.355767 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c5ed608ce044c192d2710b27f2e8bf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.356442 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c5ed608ce044c192d2710b27f2e8bf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.357052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e1d2845b-bd72-4ba7-b7c7-83ed43e41689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c5ed608ce044c192d2710b27f2e8bf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.441803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1383/2776] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:23 2022] DELETE /identity/v3/users/f0c5ed608ce044c192d2710b27f2e8bf => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:23.681467 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:23.691338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaefee6-4625-4da1-9551-8758899c1da9 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:23.722747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:23.748494 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:23.749131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:23.749436 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:23.749713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] PATH_INFO: `/v3/projects/7bace4ad0f1a48398b522a0f9ee0e9cd` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:23.750852 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bace4ad0f1a48398b522a0f9ee0e9cd)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:23.752806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:23.864243 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bace4ad0f1a48398b522a0f9ee0e9cd', 'request_id': 'req-204799b1-c771-45fb-bac6-9a6e4ee0487f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.869889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bace4ad0f1a48398b522a0f9ee0e9cd', 'request_id': 'req-204799b1-c771-45fb-bac6-9a6e4ee0487f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.973032 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bace4ad0f1a48398b522a0f9ee0e9cd', 'request_id': 'req-204799b1-c771-45fb-bac6-9a6e4ee0487f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.984674 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] The token cache is being invalidate because project 7bace4ad0f1a48398b522a0f9ee0e9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:23.984957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.985582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-204799b1-c771-45fb-bac6-9a6e4ee0487f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:23.987076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1394/2777] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:23 2022] DELETE /identity/v3/projects/7bace4ad0f1a48398b522a0f9ee0e9cd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:23.992097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066b032-1432-43c9-b855-84dc1971ecf4 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:23.992378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066b032-1432-43c9-b855-84dc1971ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:23.992652 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066b032-1432-43c9-b855-84dc1971ecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.049552 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b066b032-1432-43c9-b855-84dc1971ecf4 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:24.050768 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b066b032-1432-43c9-b855-84dc1971ecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:24.113836 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1384/2778] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:24.122086 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87cb2-889d-4549-9f3d-bd3bb274d694 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.122390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87cb2-889d-4549-9f3d-bd3bb274d694 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.122664 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87cb2-889d-4549-9f3d-bd3bb274d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.144011 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-14e87cb2-889d-4549-9f3d-bd3bb274d694 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:24.145483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-14e87cb2-889d-4549-9f3d-bd3bb274d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:24.153311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1395/2779] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:24.158176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066b032-1432-43c9-b855-84dc1971ecf4 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.167861 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066b032-1432-43c9-b855-84dc1971ecf4 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.173139 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.173733 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.174010 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.174279 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.174919 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:05:24.175255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.176916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:24.190001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1385/2780] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:05:24.194254 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87cb2-889d-4549-9f3d-bd3bb274d694 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.203910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87cb2-889d-4549-9f3d-bd3bb274d694 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.208528 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.209116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.209446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.209663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.210285 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.212210 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:24.320329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1396/2781] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:24 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:24.324620 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.335505 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5958a-aa56-4f56-8fc7-8d513adb851f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.391271 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.391680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.391945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.392212 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.392838 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.395002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:24.464268 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1386/2782] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:24 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:05:24.468367 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.478488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc068e-c407-4772-a811-173fd4941af0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.483106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.483732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.484009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.484275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.484905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.486482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:24.496242 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1397/2783] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:24.500678 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.510474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3433c62-9e72-4387-96c8-6de133330d57 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.515097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45798a-ff15-4bcf-975c-7df77027ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.516356 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45798a-ff15-4bcf-975c-7df77027ec70 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.516636 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45798a-ff15-4bcf-975c-7df77027ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.516909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45798a-ff15-4bcf-975c-7df77027ec70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.517543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45798a-ff15-4bcf-975c-7df77027ec70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.519120 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45798a-ff15-4bcf-975c-7df77027ec70 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:24.521380 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:24.529948 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1387/2784] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:24.535540 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.545481 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99cb57-5085-4d79-b6a1-c71e9898021a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.550134 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.550806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.551080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.551401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] PATH_INFO: `/v3/projects/a88f9b211e904ba4b60694670b827986/users/8d65e0a83aeb473f935cd5f64d7db74e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.566563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88f9b211e904ba4b60694670b827986, user_id=8d65e0a83aeb473f935cd5f64d7db74e, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.569240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:24.650766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1398/2785] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:24 2022] PUT /identity/v3/projects/a88f9b211e904ba4b60694670b827986/users/8d65e0a83aeb473f935cd5f64d7db74e/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:24.661116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017e72-c6b4-478f-a981-0e8b056b31bb None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.661399 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017e72-c6b4-478f-a981-0e8b056b31bb None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.661674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017e72-c6b4-478f-a981-0e8b056b31bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.690850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-8e017e72-c6b4-478f-a981-0e8b056b31bb None None] MFA Rules not processed for user `8d65e0a83aeb473f935cd5f64d7db74e`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:24.692106 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8e017e72-c6b4-478f-a981-0e8b056b31bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:24.753679 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1388/2786] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:24.758225 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.820712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c822-9708-44a5-bb3c-3cace90129d8 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.825542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.826140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.826418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.826688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.827358 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.829257 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:24.833679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:24.894396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1399/2787] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:24 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:24.898539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017e72-c6b4-478f-a981-0e8b056b31bb None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:24.909199 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017e72-c6b4-478f-a981-0e8b056b31bb None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:24.963771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:24.964370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:24.964650 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:24.964921 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:24.965546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:24.967501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:25.068296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1389/2788] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:24 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:25.072342 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:25.082576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77726d-baac-4ba6-851a-38824589c4a0 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:25.087352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:25.087945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:25.088224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:25.088496 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:25.089131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:25.090763 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:25.101353 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1400/2789] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:25.105359 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:25.115744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b41b-c081-4043-b43a-582c095e1da3 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:25.120322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:25.120952 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:25.121226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:25.121494 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] PATH_INFO: `/v3/projects/562a060a264d4dc19be22f3d0f9252cb/users/7b558032cd1547bcbd90ec4ba077a09c/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:25.141465 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562a060a264d4dc19be22f3d0f9252cb, user_id=7b558032cd1547bcbd90ec4ba077a09c, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:25.144655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:25.210915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1390/2790] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:25 2022] PUT /identity/v3/projects/562a060a264d4dc19be22f3d0f9252cb/users/7b558032cd1547bcbd90ec4ba077a09c/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:25.214869 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:25.225349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3056-bedc-4608-98cd-5648d991bd9c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:25.280530 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754d6c3-2e0c-4861-bb6c-bbc1ab72d276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:25.281631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d6c3-2e0c-4861-bb6c-bbc1ab72d276 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:25.281907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d6c3-2e0c-4861-bb6c-bbc1ab72d276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:25.282183 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d6c3-2e0c-4861-bb6c-bbc1ab72d276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:25.282818 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754d6c3-2e0c-4861-bb6c-bbc1ab72d276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:25.284449 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754d6c3-2e0c-4861-bb6c-bbc1ab72d276 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:25.293935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1401/2791] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:25.298683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:25.308910 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ec66-4ea2-42fb-8a6f-fb760038ab76 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:25.313532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:25.314165 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:25.314441 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:25.314713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] PATH_INFO: `/v3/projects/562a060a264d4dc19be22f3d0f9252cb/users/7b558032cd1547bcbd90ec4ba077a09c/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:25.316644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562a060a264d4dc19be22f3d0f9252cb, user_id=7b558032cd1547bcbd90ec4ba077a09c, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:25.319345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:25.329321 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1391/2792] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:25 2022] PUT /identity/v3/projects/562a060a264d4dc19be22f3d0f9252cb/users/7b558032cd1547bcbd90ec4ba077a09c/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:25.339394 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c574d-488e-4d7f-9151-d59d56af2c07 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:25.339675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c574d-488e-4d7f-9151-d59d56af2c07 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:25.339945 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c574d-488e-4d7f-9151-d59d56af2c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:25.369835 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-4d8c574d-488e-4d7f-9151-d59d56af2c07 None None] MFA Rules not processed for user `7b558032cd1547bcbd90ec4ba077a09c`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:25.371019 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-4d8c574d-488e-4d7f-9151-d59d56af2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:25.438230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1402/2793] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:25.448840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:25.450489 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:25.493647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:25.507080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61853747-e026-4832-91a6-83519620aab5 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:25.510993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7a221-56db-40de-ac40-a478b1134a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:25.511626 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a221-56db-40de-ac40-a478b1134a80 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:25.511905 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a221-56db-40de-ac40-a478b1134a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:25.512176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a221-56db-40de-ac40-a478b1134a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:25.521883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7a221-56db-40de-ac40-a478b1134a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:25.523345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7a221-56db-40de-ac40-a478b1134a80 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:25.533624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1392/2794] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:28.282230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c574d-488e-4d7f-9151-d59d56af2c07 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:28.337140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:28.342564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c574d-488e-4d7f-9151-d59d56af2c07 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:28.347557 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:28.348176 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:28.348453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:28.348723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] PATH_INFO: `/v3/users/8d65e0a83aeb473f935cd5f64d7db74e` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:28.349836 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d65e0a83aeb473f935cd5f64d7db74e)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:28.351778 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:28.535277 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d65e0a83aeb473f935cd5f64d7db74e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:28.535923 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d65e0a83aeb473f935cd5f64d7db74e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:28.542706 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d65e0a83aeb473f935cd5f64d7db74e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:28.601230 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d65e0a83aeb473f935cd5f64d7db74e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:28.613159 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d65e0a83aeb473f935cd5f64d7db74e'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:28.618937 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1403/2795] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:28 2022] DELETE /identity/v3/users/8d65e0a83aeb473f935cd5f64d7db74e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:28.623424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4283-574d-4c24-99be-c9176166e337 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:28.623935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4283-574d-4c24-99be-c9176166e337 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:28.623935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e4283-574d-4c24-99be-c9176166e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:28.643846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-659e4283-574d-4c24-99be-c9176166e337 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:28.645302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-659e4283-574d-4c24-99be-c9176166e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:28.703955 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1393/2796] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:28.713600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:28.714981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:28.793502 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6041974-917b-4b18-a4ab-ce8ae41aa2fb admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:28.797091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:28.797689 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:28.797966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:28.798238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:28.807022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:28.808474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:28.818211 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1404/2797] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:29.226000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e4283-574d-4c24-99be-c9176166e337 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:29.227450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-659e4283-574d-4c24-99be-c9176166e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:29.241025 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e4283-574d-4c24-99be-c9176166e337 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:29.246146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:29.246779 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:29.247059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:29.247361 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] PATH_INFO: `/v3/projects/a88f9b211e904ba4b60694670b827986` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:29.248486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88f9b211e904ba4b60694670b827986)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:29.251234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:29.350942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88f9b211e904ba4b60694670b827986', 'request_id': 'req-02b5134c-7996-4712-849b-37f125255ccf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.357042 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88f9b211e904ba4b60694670b827986', 'request_id': 'req-02b5134c-7996-4712-849b-37f125255ccf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.432820 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88f9b211e904ba4b60694670b827986', 'request_id': 'req-02b5134c-7996-4712-849b-37f125255ccf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.443539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] The token cache is being invalidate because project a88f9b211e904ba4b60694670b827986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:29.443847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.444471 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.445972 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1394/2798] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:29 2022] DELETE /identity/v3/projects/a88f9b211e904ba4b60694670b827986 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:29.449956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:29.459908 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bea14-05fa-4eba-bb60-1ba9d6198329 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:29.509144 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:29.514851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:29.516770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:29.516770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:29.516770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] PATH_INFO: `/v3/users/7b558032cd1547bcbd90ec4ba077a09c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:29.517663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b558032cd1547bcbd90ec4ba077a09c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:29.519873 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:29.691912 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b558032cd1547bcbd90ec4ba077a09c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.692587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b558032cd1547bcbd90ec4ba077a09c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.699310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b558032cd1547bcbd90ec4ba077a09c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.761433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b558032cd1547bcbd90ec4ba077a09c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.773542 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-e1a71611-b4a3-4089-bb99-107d7e8212ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b558032cd1547bcbd90ec4ba077a09c'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:29.779363 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1405/2799] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:29 2022] DELETE /identity/v3/users/7b558032cd1547bcbd90ec4ba077a09c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:30.377686 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:30.379118 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:30.395330 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5134c-7996-4712-849b-37f125255ccf admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:30.451915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:30.452539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:30.452817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:30.453089 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] PATH_INFO: `/v3/projects/562a060a264d4dc19be22f3d0f9252cb` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:30.454209 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562a060a264d4dc19be22f3d0f9252cb)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:30.456147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:30.463846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:30.570197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562a060a264d4dc19be22f3d0f9252cb', 'request_id': 'req-e14621f8-7462-4194-a706-201da8b123b7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:30.576178 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562a060a264d4dc19be22f3d0f9252cb', 'request_id': 'req-e14621f8-7462-4194-a706-201da8b123b7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:30.621115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562a060a264d4dc19be22f3d0f9252cb', 'request_id': 'req-e14621f8-7462-4194-a706-201da8b123b7'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:30.632083 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] The token cache is being invalidate because project 562a060a264d4dc19be22f3d0f9252cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:30.632360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:30.632991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-e14621f8-7462-4194-a706-201da8b123b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:30.634487 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1395/2800] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:30 2022] DELETE /identity/v3/projects/562a060a264d4dc19be22f3d0f9252cb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:30.639385 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc88d2-19a1-425c-9941-d0ae5907088b None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:30.639864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc88d2-19a1-425c-9941-d0ae5907088b None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:30.639996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc88d2-19a1-425c-9941-d0ae5907088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:30.660984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-a0cc88d2-19a1-425c-9941-d0ae5907088b None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:30.662190 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-a0cc88d2-19a1-425c-9941-d0ae5907088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:30.721090 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1406/2801] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:30.730241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ae0c8-5b51-4144-8383-aab55d9f2ab8 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:30.730523 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ae0c8-5b51-4144-8383-aab55d9f2ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:30.730792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ae0c8-5b51-4144-8383-aab55d9f2ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:30.750473 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-547ae0c8-5b51-4144-8383-aab55d9f2ab8 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:30.751759 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-547ae0c8-5b51-4144-8383-aab55d9f2ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:30.759529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1396/2802] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:30.763566 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc88d2-19a1-425c-9941-d0ae5907088b None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:30.773875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc88d2-19a1-425c-9941-d0ae5907088b None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:30.778402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:30.778992 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:30.779320 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:30.779597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:30.780240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:05:30.781201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:30.782801 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:30.794209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1407/2803] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:05:30.798710 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ae0c8-5b51-4144-8383-aab55d9f2ab8 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:30.807986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ae0c8-5b51-4144-8383-aab55d9f2ab8 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:30.812562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:30.813142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:30.813415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:30.813680 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:30.814293 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:30.816259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:30.917080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1397/2804] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:30 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:30.921180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:30.931328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01433ca-d306-4701-8fa1-a9a0f5b51582 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:30.986580 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:30.987202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:30.987485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:30.987816 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:30.988452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:30.990402 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.000495 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:31.138957 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1408/2805] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:30 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:31.143681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.154115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5aba-82b9-4751-b0b3-2e01bf4300db admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.158659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.159273 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.161221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.161221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.161221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.162045 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.171868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1398/2806] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:31.175615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.185582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4fa8-87a5-48e6-a6bd-9e1727c7f298 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.190711 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a247f56-6905-4751-a929-f89e012708f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.191332 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a247f56-6905-4751-a929-f89e012708f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.191614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a247f56-6905-4751-a929-f89e012708f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.191888 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a247f56-6905-4751-a929-f89e012708f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.192521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a247f56-6905-4751-a929-f89e012708f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.194143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a247f56-6905-4751-a929-f89e012708f6 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.205653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1409/2807] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:31.209525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.219707 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35a29-e8a7-4ee1-aed0-916c014bbdbc admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.224236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.224873 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.225157 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.225431 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] PATH_INFO: `/v3/projects/dafbc964c578492686cb5d8c6a1fe6b7/users/1f788a9c3a7d408db20f4f2134b9ecc9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.239848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafbc964c578492686cb5d8c6a1fe6b7, user_id=1f788a9c3a7d408db20f4f2134b9ecc9, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.242587 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.333617 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1399/2808] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:31 2022] PUT /identity/v3/projects/dafbc964c578492686cb5d8c6a1fe6b7/users/1f788a9c3a7d408db20f4f2134b9ecc9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:05:31.343938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c671-dc47-416b-9d32-0d652d1a3a38 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.344224 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c671-dc47-416b-9d32-0d652d1a3a38 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.344568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c671-dc47-416b-9d32-0d652d1a3a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.371514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5eb4c671-dc47-416b-9d32-0d652d1a3a38 None None] MFA Rules not processed for user `1f788a9c3a7d408db20f4f2134b9ecc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:31.372774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5eb4c671-dc47-416b-9d32-0d652d1a3a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:31.443784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1410/2809] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:31.448229 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.508172 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6a8bd-a4b9-4216-8adb-1558a9464dc7 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.512674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.513270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.513525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.513791 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.514400 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.516339 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.619732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1400/2810] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:31 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:31.623709 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c671-dc47-416b-9d32-0d652d1a3a38 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.634803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c671-dc47-416b-9d32-0d652d1a3a38 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.692514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.693199 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.693372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.693635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.694312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.696263 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.766928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1411/2811] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:31 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:31.771149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.781162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac168b2-0ac1-4f2e-acad-48d3e24f34af admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.785860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.786453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.786755 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.787027 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.787719 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.789405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.800371 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1401/2812] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:31.804297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.814864 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe32d7-82b1-419a-a409-351a23ccac8d admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.819413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.820045 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.820321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.820591 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] PATH_INFO: `/v3/projects/6440a9519346468e8af75010f5d879d8/users/477b039e34564ecc9975b30f16fc46ca/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.834891 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6440a9519346468e8af75010f5d879d8, user_id=477b039e34564ecc9975b30f16fc46ca, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.837564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:31.922200 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1412/2813] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:31 2022] PUT /identity/v3/projects/6440a9519346468e8af75010f5d879d8/users/477b039e34564ecc9975b30f16fc46ca/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:31.926122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:31.936148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991be1-315e-4b72-b45d-3b07e513eb8b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:31.939596 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:31.995589 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf476428-f4ba-452d-8c2a-fb2bd2ba3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:31.996113 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf476428-f4ba-452d-8c2a-fb2bd2ba3305 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:31.996397 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf476428-f4ba-452d-8c2a-fb2bd2ba3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:31.996668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf476428-f4ba-452d-8c2a-fb2bd2ba3305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:31.997300 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf476428-f4ba-452d-8c2a-fb2bd2ba3305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:31.998911 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf476428-f4ba-452d-8c2a-fb2bd2ba3305 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:32.008301 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1402/2814] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:32.012474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:32.023116 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17eff-48f7-48ae-bb1f-0bee68c94c4b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:32.027917 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:32.028560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:32.028841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:32.029112 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] PATH_INFO: `/v3/projects/6440a9519346468e8af75010f5d879d8/users/477b039e34564ecc9975b30f16fc46ca/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:32.031621 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6440a9519346468e8af75010f5d879d8, user_id=477b039e34564ecc9975b30f16fc46ca, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:32.034270 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:32.044347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1413/2815] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:32 2022] PUT /identity/v3/projects/6440a9519346468e8af75010f5d879d8/users/477b039e34564ecc9975b30f16fc46ca/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:32.055096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:32.055437 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:32.061914 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:32.082659 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] MFA Rules not processed for user `477b039e34564ecc9975b30f16fc46ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:32.083907 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:32.152067 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1403/2816] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:32.164564 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:32.166248 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:32.193426 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:32.246142 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192de4-84fc-4d13-a324-d81741fe6fd1 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:32.249978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:32.250603 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:32.250875 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:32.251140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:32.260069 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:32.261474 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:32.271938 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1414/2817] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:32.381535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:32.383003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:32.395486 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f124c-fdac-4e61-b42c-3b6b7757d1ea None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:32.398999 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0a520-d009-4457-a597-71257ee00f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:32.399619 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0a520-d009-4457-a597-71257ee00f66 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:32.399893 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0a520-d009-4457-a597-71257ee00f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:32.400155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0a520-d009-4457-a597-71257ee00f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:32.455681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0a520-d009-4457-a597-71257ee00f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:32.457145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0a520-d009-4457-a597-71257ee00f66 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:32.465957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1404/2818] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:37.205932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:37.266038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e3b9-2481-4438-8465-e35037ae460b service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:37.271514 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:37.272126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:37.272404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:37.272673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] PATH_INFO: `/v3/users/1f788a9c3a7d408db20f4f2134b9ecc9` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:37.273777 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f788a9c3a7d408db20f4f2134b9ecc9)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:37.275731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:37.426347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f788a9c3a7d408db20f4f2134b9ecc9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:37.426996 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f788a9c3a7d408db20f4f2134b9ecc9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:37.433965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f788a9c3a7d408db20f4f2134b9ecc9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:37.492312 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f788a9c3a7d408db20f4f2134b9ecc9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:37.505269 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f788a9c3a7d408db20f4f2134b9ecc9'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:37.511404 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1415/2819] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:37 2022] DELETE /identity/v3/users/1f788a9c3a7d408db20f4f2134b9ecc9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:37.515860 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:37.516388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:37.516490 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:37.535196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:37.536408 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:37.556424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=100 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:37.594491 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1405/2820] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:37.604131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:37.605597 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:37.638583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:37.667140 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca06d-720c-4d2e-99f9-87510559d8d2 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:37.670795 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:37.671432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:37.671877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:37.672854 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:37.682421 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:37.684061 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:37.693910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1416/2821] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:38.118855 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:38.120466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:38.136817 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea28ea-95d9-475a-a0d1-e386e817f673 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:38.143085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:38.147454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:38.147454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:38.147454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] PATH_INFO: `/v3/projects/dafbc964c578492686cb5d8c6a1fe6b7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:38.147454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafbc964c578492686cb5d8c6a1fe6b7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:38.148303 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:38.264851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafbc964c578492686cb5d8c6a1fe6b7', 'request_id': 'req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.272003 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafbc964c578492686cb5d8c6a1fe6b7', 'request_id': 'req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.355470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafbc964c578492686cb5d8c6a1fe6b7', 'request_id': 'req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.366925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] The token cache is being invalidate because project dafbc964c578492686cb5d8c6a1fe6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:38.367242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.367991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.369503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1406/2822] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:38 2022] DELETE /identity/v3/projects/dafbc964c578492686cb5d8c6a1fe6b7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:38.373638 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:38.383994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f353109-662b-41fe-9444-27a85457ece5 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:38.445066 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:38.445692 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:38.446005 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:38.446272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] PATH_INFO: `/v3/users/477b039e34564ecc9975b30f16fc46ca` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:38.447418 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=477b039e34564ecc9975b30f16fc46ca)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:38.449338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:38.637660 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477b039e34564ecc9975b30f16fc46ca'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.638307 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477b039e34564ecc9975b30f16fc46ca'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.645522 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477b039e34564ecc9975b30f16fc46ca'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.718456 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477b039e34564ecc9975b30f16fc46ca'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.731485 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-7fd8033a-9c8a-4e96-b150-cb579114e24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477b039e34564ecc9975b30f16fc46ca'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:38.737889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1417/2823] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:38 2022] DELETE /identity/v3/users/477b039e34564ecc9975b30f16fc46ca => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:39.154160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:39.155749 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:39.169950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2647c22-cbe7-49ca-8eb9-5892959eb0a2 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:39.226647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:39.227307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.227590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.227863 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] PATH_INFO: `/v3/projects/6440a9519346468e8af75010f5d879d8` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.228976 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6440a9519346468e8af75010f5d879d8)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:39.230995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:39.331414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6440a9519346468e8af75010f5d879d8', 'request_id': 'req-007068ef-8102-443e-85c1-4697a0acaf37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:39.333232 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:39.337611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6440a9519346468e8af75010f5d879d8', 'request_id': 'req-007068ef-8102-443e-85c1-4697a0acaf37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:39.404354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6440a9519346468e8af75010f5d879d8', 'request_id': 'req-007068ef-8102-443e-85c1-4697a0acaf37'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:39.415041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] The token cache is being invalidate because project 6440a9519346468e8af75010f5d879d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:39.415406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:39.416039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-007068ef-8102-443e-85c1-4697a0acaf37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:39.417515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1407/2824] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:39 2022] DELETE /identity/v3/projects/6440a9519346468e8af75010f5d879d8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:39.422452 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2e968-83f5-44f8-9317-4d9c42d200fa None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.422944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2e968-83f5-44f8-9317-4d9c42d200fa None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.423048 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2e968-83f5-44f8-9317-4d9c42d200fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.443115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-1ab2e968-83f5-44f8-9317-4d9c42d200fa None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:39.444330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-1ab2e968-83f5-44f8-9317-4d9c42d200fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:39.487472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:39.502684 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1418/2825] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:39.511136 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d4c8-eed7-409b-995d-8806c255aec3 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.511459 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d4c8-eed7-409b-995d-8806c255aec3 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.511738 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d4c8-eed7-409b-995d-8806c255aec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.532582 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-e524d4c8-eed7-409b-995d-8806c255aec3 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:39.533790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-e524d4c8-eed7-409b-995d-8806c255aec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:39.541826 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1408/2826] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:05:39.545950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2e968-83f5-44f8-9317-4d9c42d200fa None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:39.555925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2e968-83f5-44f8-9317-4d9c42d200fa None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:39.560586 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:39.561175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.561450 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.561716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.562352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:05:39.562652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:39.564797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:39.576548 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1419/2827] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:05:39.581351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d4c8-eed7-409b-995d-8806c255aec3 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:39.590842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d4c8-eed7-409b-995d-8806c255aec3 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:39.595825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:39.596601 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.596886 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.597160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.597797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:39.599722 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:39.678039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1409/2828] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:39 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:39.682149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:39.692989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bbf57-4959-49c7-a97f-7f00b802e31e admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:39.751998 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:39.752595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.752874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.753174 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.753791 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:39.755741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:39.826666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1420/2829] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:39 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:39.831124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:39.841419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9915f-1ca3-402d-99ca-96cdcd648dcd admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:39.846182 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:39.846764 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.847039 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.847342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.847980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:39.849613 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:39.859308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1410/2830] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:39.863774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:39.873683 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f2b97-787a-4746-822c-71b18e8298e2 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:39.878946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02486759-cf7d-4711-9814-10633710c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:39.879571 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486759-cf7d-4711-9814-10633710c216 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.879859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486759-cf7d-4711-9814-10633710c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.880136 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486759-cf7d-4711-9814-10633710c216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.880779 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02486759-cf7d-4711-9814-10633710c216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:39.882410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02486759-cf7d-4711-9814-10633710c216 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:39.893328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1421/2831] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:39.903539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:39.913559 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94689b-f760-4a23-9fa3-ece022b6623c admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:39.918124 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:39.918753 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:39.919029 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:39.919329 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] PATH_INFO: `/v3/projects/de0ca795ab1945a1b41689f9594b3ad5/users/fffa2831c3c041a2abaff01ec2deaaa9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:39.934575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0ca795ab1945a1b41689f9594b3ad5, user_id=fffa2831c3c041a2abaff01ec2deaaa9, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:39.937185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:40.024404 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1411/2832] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:39 2022] PUT /identity/v3/projects/de0ca795ab1945a1b41689f9594b3ad5/users/fffa2831c3c041a2abaff01ec2deaaa9/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:40.035308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa654-132f-48b8-aabc-66e488106644 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.035594 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa654-132f-48b8-aabc-66e488106644 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.035893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa654-132f-48b8-aabc-66e488106644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.063783 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f19aa654-132f-48b8-aabc-66e488106644 None None] MFA Rules not processed for user `fffa2831c3c041a2abaff01ec2deaaa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:40.064989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f19aa654-132f-48b8-aabc-66e488106644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:40.129168 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1422/2833] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:40.133663 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:40.194698 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f728ea8-6bf4-4553-b192-b23a57e515a3 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:40.199298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:40.199887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.200163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.200432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.201060 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:40.202945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:40.310790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1412/2834] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:40 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:40.322576 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa654-132f-48b8-aabc-66e488106644 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:40.335067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa654-132f-48b8-aabc-66e488106644 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:40.379041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:40.393880 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:40.394742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.395013 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.395315 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.395944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:40.397867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:40.480977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1423/2835] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:40 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:40.484980 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:40.495373 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eab16-71ed-4dea-9cb3-1a6f11a61602 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:40.500138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:40.500743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.501001 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.501269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.501904 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:40.503580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:40.514052 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1413/2836] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:40.518489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:40.528675 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15174442-3283-4cc7-95e6-9e5379eca479 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:40.534288 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b859b6-5b70-4457-b792-31be2f1e9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:40.534874 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b859b6-5b70-4457-b792-31be2f1e9b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.535177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b859b6-5b70-4457-b792-31be2f1e9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.535453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b859b6-5b70-4457-b792-31be2f1e9b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.536085 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b859b6-5b70-4457-b792-31be2f1e9b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:40.537672 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b859b6-5b70-4457-b792-31be2f1e9b59 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:40.547375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1424/2837] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:05:40.551341 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:40.561116 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf54ac-c032-42a1-a4aa-dbd0a4a6db17 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:40.565962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:40.566590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.566867 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.567138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] PATH_INFO: `/v3/projects/2d31f630396f4f889c4c7af5e5066147/users/a2dd3ff487c94b0882c07ce36f101b17/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.582869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d31f630396f4f889c4c7af5e5066147, user_id=a2dd3ff487c94b0882c07ce36f101b17, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:40.598941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:40.696187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1414/2838] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:40 2022] PUT /identity/v3/projects/2d31f630396f4f889c4c7af5e5066147/users/a2dd3ff487c94b0882c07ce36f101b17/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:40.759829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1a48-b8da-4569-b736-cc3cf2f8e8d9 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.760025 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1a48-b8da-4569-b736-cc3cf2f8e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.760308 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1a48-b8da-4569-b736-cc3cf2f8e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.788590 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-e33f1a48-b8da-4569-b736-cc3cf2f8e8d9 None None] MFA Rules not processed for user `a2dd3ff487c94b0882c07ce36f101b17`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:40.789796 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-e33f1a48-b8da-4569-b736-cc3cf2f8e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:40.851963 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1425/2839] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:40.856414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:40.885890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:40.917668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecdc4c-64e6-41e2-a57d-6f63fffd2402 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:40.922264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:40.924292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:40.924292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:40.924292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:40.924292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:40.925902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:41.028069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1415/2840] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:40 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:41.032091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f1a48-b8da-4569-b736-cc3cf2f8e8d9 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:41.042667 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f1a48-b8da-4569-b736-cc3cf2f8e8d9 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:41.099968 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:41.101761 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:41.102040 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:41.102311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:41.102944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:41.104895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:41.179012 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1426/2841] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:41 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:41.183195 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:41.194133 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ea87e-de25-4f56-bfc6-4934be6f16ad admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:41.198783 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:41.202378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:41.202378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:41.202378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:41.202378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:41.202378 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:41.211897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1416/2842] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:41.215825 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:41.225954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3740d04-ff9b-4f83-a93a-a1387faa68f4 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:41.230696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:41.231379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:41.231663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:41.231935 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] PATH_INFO: `/v3/projects/6c9f071fb1fc429fabbeb43dfa92d075/users/32c029e64a8245aba9def74926aa9acf/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:41.246966 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9f071fb1fc429fabbeb43dfa92d075, user_id=32c029e64a8245aba9def74926aa9acf, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:41.249682 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:41.329673 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1427/2843] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:41 2022] PUT /identity/v3/projects/6c9f071fb1fc429fabbeb43dfa92d075/users/32c029e64a8245aba9def74926aa9acf/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:05:41.333520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:41.343685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31754ed-11ec-4697-b3ab-93c0e885ad9b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:41.401821 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3309c-10f3-492d-ab64-494724847ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:41.402418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3309c-10f3-492d-ab64-494724847ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:41.402693 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3309c-10f3-492d-ab64-494724847ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:41.402960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3309c-10f3-492d-ab64-494724847ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:41.403621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3309c-10f3-492d-ab64-494724847ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:41.405208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3309c-10f3-492d-ab64-494724847ec9 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:41.415030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1417/2844] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:41.419271 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:41.430039 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c291d34-1e03-4aa6-b7c8-d3017abe5907 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:41.434747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:41.435419 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:41.435696 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:41.435964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] PATH_INFO: `/v3/projects/6c9f071fb1fc429fabbeb43dfa92d075/users/32c029e64a8245aba9def74926aa9acf/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:41.438470 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9f071fb1fc429fabbeb43dfa92d075, user_id=32c029e64a8245aba9def74926aa9acf, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:41.441227 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:41.451411 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1428/2845] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:41 2022] PUT /identity/v3/projects/6c9f071fb1fc429fabbeb43dfa92d075/users/32c029e64a8245aba9def74926aa9acf/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:41.461327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:41.461615 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:41.461892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:41.489849 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] MFA Rules not processed for user `32c029e64a8245aba9def74926aa9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:41.491064 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:41.558369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1418/2846] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:41.569189 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:41.570942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:41.577489 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:41.628768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b76f-3e63-4461-b75d-aca1f6809f98 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:41.632837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:41.633442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:41.633720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:41.634000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:41.643539 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:41.645235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:41.657339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1429/2847] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:42.679872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:42.681266 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:42.693716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f58a9-0533-48b9-a217-575bc0d3d129 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:42.697280 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:42.697869 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:42.698148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:42.698422 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:42.717000 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:42.756253 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:42.758095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:42.769670 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1419/2848] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:47.662714 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:47.671554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d92e6-1d1f-4318-aa82-c15add12b537 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:47.675202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17443b3-777d-4a19-b7c5-78402c087bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:47.675792 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17443b3-777d-4a19-b7c5-78402c087bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:47.676076 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17443b3-777d-4a19-b7c5-78402c087bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:47.676339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17443b3-777d-4a19-b7c5-78402c087bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:47.732265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17443b3-777d-4a19-b7c5-78402c087bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:47.733623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17443b3-777d-4a19-b7c5-78402c087bf2 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:47.742500 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1430/2849] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:51.746363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:51.807432 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc172206-e102-4c2a-924b-166057bfa6bd service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:51.811957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:51.812568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:51.812840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:51.813112 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] PATH_INFO: `/v3/users/fffa2831c3c041a2abaff01ec2deaaa9` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:51.814215 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffa2831c3c041a2abaff01ec2deaaa9)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:51.816162 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:51.968019 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffa2831c3c041a2abaff01ec2deaaa9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:51.980766 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffa2831c3c041a2abaff01ec2deaaa9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:51.987597 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffa2831c3c041a2abaff01ec2deaaa9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:51.988307 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffa2831c3c041a2abaff01ec2deaaa9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:51.988915 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffa2831c3c041a2abaff01ec2deaaa9'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:52.058969 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1420/2850] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:51 2022] DELETE /identity/v3/users/fffa2831c3c041a2abaff01ec2deaaa9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:52.063677 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:52.064192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:52.064357 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:52.083325 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:52.084523 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:52.144629 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1431/2851] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:52.154479 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:52.155938 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:52.200450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:52.213896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc0ea3-258f-4425-975a-15667f1bc941 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:52.217586 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:52.218226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:52.218474 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:52.218744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:52.227988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:52.229429 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:52.238957 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1421/2852] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:52.673906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:52.675365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:52.689680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f936-eade-4e41-ae87-6437af148d50 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:52.696799 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:52.698425 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:52.698807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:52.701105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] PATH_INFO: `/v3/projects/de0ca795ab1945a1b41689f9594b3ad5` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:52.702536 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0ca795ab1945a1b41689f9594b3ad5)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:52.704491 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:52.794724 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:52.800577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0ca795ab1945a1b41689f9594b3ad5', 'request_id': 'req-fdcae4f2-f983-433d-af18-e49a4349550f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:52.806007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0ca795ab1945a1b41689f9594b3ad5', 'request_id': 'req-fdcae4f2-f983-433d-af18-e49a4349550f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:52.886282 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0ca795ab1945a1b41689f9594b3ad5', 'request_id': 'req-fdcae4f2-f983-433d-af18-e49a4349550f'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:52.898892 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] The token cache is being invalidate because project de0ca795ab1945a1b41689f9594b3ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:52.899202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:52.899829 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:52.901311 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1432/2853] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:52 2022] DELETE /identity/v3/projects/de0ca795ab1945a1b41689f9594b3ad5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:52.905379 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:52.914960 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e956e58-f7b7-4065-81a7-481b586964e6 service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:52.969696 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:52.970313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:52.970593 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:52.970862 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] PATH_INFO: `/v3/users/a2dd3ff487c94b0882c07ce36f101b17` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:52.972086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2dd3ff487c94b0882c07ce36f101b17)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:52.974004 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:53.143488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2dd3ff487c94b0882c07ce36f101b17'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.155991 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2dd3ff487c94b0882c07ce36f101b17'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.163428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2dd3ff487c94b0882c07ce36f101b17'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.164141 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2dd3ff487c94b0882c07ce36f101b17'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.164739 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2dd3ff487c94b0882c07ce36f101b17'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.234646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1422/2854] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:52 2022] DELETE /identity/v3/users/a2dd3ff487c94b0882c07ce36f101b17 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:53.629946 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:53.631898 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:53.645737 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcae4f2-f983-433d-af18-e49a4349550f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:53.704554 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:53.705137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:53.705414 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:53.705688 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] PATH_INFO: `/v3/projects/2d31f630396f4f889c4c7af5e5066147` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:53.706811 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d31f630396f4f889c4c7af5e5066147)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:53.709537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:53.840723 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d31f630396f4f889c4c7af5e5066147', 'request_id': 'req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.846149 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d31f630396f4f889c4c7af5e5066147', 'request_id': 'req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.903922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d31f630396f4f889c4c7af5e5066147', 'request_id': 'req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.915488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] The token cache is being invalidate because project 2d31f630396f4f889c4c7af5e5066147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:53.915776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.916413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:53.918021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1433/2855] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:53 2022] DELETE /identity/v3/projects/2d31f630396f4f889c4c7af5e5066147 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:53.921984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:53.923440 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:53.936561 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de453149-73c1-4b1a-9923-fa7f411fbea2 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:53.994750 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:53.995342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:53.995624 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:53.995895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] PATH_INFO: `/v3/users/32c029e64a8245aba9def74926aa9acf` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:53.997016 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c029e64a8245aba9def74926aa9acf)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:53.998937 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:54.001242 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:54.178297 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c029e64a8245aba9def74926aa9acf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.190202 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c029e64a8245aba9def74926aa9acf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.196848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c029e64a8245aba9def74926aa9acf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.197506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c029e64a8245aba9def74926aa9acf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.198207 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-425f6a24-f30d-461b-b1be-5697adc5d7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c029e64a8245aba9def74926aa9acf'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.265621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1423/2856] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:05:53 2022] DELETE /identity/v3/users/32c029e64a8245aba9def74926aa9acf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:54.684351 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:54.685909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:54.700331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e8e8-4b5c-4d7c-b2cd-71335d9469ac admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:54.755958 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:54.756582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:54.756859 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:54.757131 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] PATH_INFO: `/v3/projects/6c9f071fb1fc429fabbeb43dfa92d075` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:54.758266 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9f071fb1fc429fabbeb43dfa92d075)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:54.760206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:54.761622 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:54.866681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9f071fb1fc429fabbeb43dfa92d075', 'request_id': 'req-004f8c10-37b0-4244-b77f-5400382034dd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.871902 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9f071fb1fc429fabbeb43dfa92d075', 'request_id': 'req-004f8c10-37b0-4244-b77f-5400382034dd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.946749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9f071fb1fc429fabbeb43dfa92d075', 'request_id': 'req-004f8c10-37b0-4244-b77f-5400382034dd'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.957838 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] The token cache is being invalidate because project 6c9f071fb1fc429fabbeb43dfa92d075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:05:54.958128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.958788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-004f8c10-37b0-4244-b77f-5400382034dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:05:54.960871 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1434/2857] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:05:54 2022] DELETE /identity/v3/projects/6c9f071fb1fc429fabbeb43dfa92d075 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:54.966851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8bdf6-b373-4545-b91e-652c9d591043 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:54.967366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8bdf6-b373-4545-b91e-652c9d591043 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:54.967566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8bdf6-b373-4545-b91e-652c9d591043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:54.986993 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-a9a8bdf6-b373-4545-b91e-652c9d591043 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:54.988213 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a9a8bdf6-b373-4545-b91e-652c9d591043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:55.048095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1424/2858] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:55.056589 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6193-782c-4e24-8b4a-ed65b7844eb0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.056878 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6193-782c-4e24-8b4a-ed65b7844eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.057182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6193-782c-4e24-8b4a-ed65b7844eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.077162 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-671d6193-782c-4e24-8b4a-ed65b7844eb0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:55.078366 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-671d6193-782c-4e24-8b4a-ed65b7844eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:55.086837 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1435/2859] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:55.091146 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8bdf6-b373-4545-b91e-652c9d591043 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.100599 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8bdf6-b373-4545-b91e-652c9d591043 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.105095 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.105708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.105985 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.106255 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.106890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:05:55.107217 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.108803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:55.120313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1425/2860] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:05:55.124375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6193-782c-4e24-8b4a-ed65b7844eb0 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.134053 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6193-782c-4e24-8b4a-ed65b7844eb0 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.138844 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.139464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.139742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.140009 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.140640 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.142521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:55.257774 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1436/2861] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:55 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:05:55.261975 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.272187 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb791-cfba-4a49-a7f3-f1ef860dcbba admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.326997 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.327608 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.327883 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.328152 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.328798 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.330695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:55.421548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:55.427298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1426/2862] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:55 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:55.431977 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.442635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02ca2-6064-4f9c-ba61-b05ffb8b122b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.447896 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.448488 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.448766 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.449041 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.449679 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.451296 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:55.461092 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1437/2863] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:55.466646 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.476890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff77b4d-5f9c-4fcc-b9a5-dd17984bbe00 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.481674 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c3d9b-7530-4d1e-9742-b1d9d248231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.482290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3d9b-7530-4d1e-9742-b1d9d248231e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.482567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3d9b-7530-4d1e-9742-b1d9d248231e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.482864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c3d9b-7530-4d1e-9742-b1d9d248231e admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.483540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3d9b-7530-4d1e-9742-b1d9d248231e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.485155 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c3d9b-7530-4d1e-9742-b1d9d248231e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:55.496684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1427/2864] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:55.500770 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.511464 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a37c-ec43-455b-bbd8-9b7774eedef9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.516078 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.516716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.516994 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.517267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] PATH_INFO: `/v3/projects/37a1f217c784403b839520791dc6050d/users/6909bb4091784570954a83aa16319e9d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.531851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a1f217c784403b839520791dc6050d, user_id=6909bb4091784570954a83aa16319e9d, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.534513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:55.641509 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1438/2865] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:55 2022] PUT /identity/v3/projects/37a1f217c784403b839520791dc6050d/users/6909bb4091784570954a83aa16319e9d/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:55.655677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3713-5a2b-4dda-8726-360ca83f8e03 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.655677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3713-5a2b-4dda-8726-360ca83f8e03 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.655677 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3713-5a2b-4dda-8726-360ca83f8e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.682823 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-970e3713-5a2b-4dda-8726-360ca83f8e03 None None] MFA Rules not processed for user `6909bb4091784570954a83aa16319e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:55.683989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-970e3713-5a2b-4dda-8726-360ca83f8e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:55.749160 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1428/2866] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:55.753649 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.813473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49ad2c-0d79-49e9-bf62-a5b98793276f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.818238 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.818942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.819249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.819577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.820223 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.822137 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:55.890572 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1439/2867] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:05:55 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:55.894842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e3713-5a2b-4dda-8726-360ca83f8e03 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:55.905466 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e3713-5a2b-4dda-8726-360ca83f8e03 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:55.960201 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:55.960747 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:55.961018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:55.961282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:55.961896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:55.963875 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:56.045075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1429/2868] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:05:55 2022] POST /identity/v3/users => generated 307 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:05:56.049043 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:56.059909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e5b6-362c-44a2-9333-f43d2707dfee admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:56.064867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:56.065521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:56.065802 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:56.066072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:56.066762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:56.068405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:56.073931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:56.079738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1440/2869] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:05:56.084388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:56.094548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc8c40-1587-4e49-ac29-1776765a563b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:56.099147 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:56.100520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:56.100790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:56.101059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] PATH_INFO: `/v3/projects/c63399b312ff432ca658d21de0142b43/users/d3589fa1480344cb893f3be9c19d25e4/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:56.115872 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63399b312ff432ca658d21de0142b43, user_id=d3589fa1480344cb893f3be9c19d25e4, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:56.118565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:56.189660 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1430/2870] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:56 2022] PUT /identity/v3/projects/c63399b312ff432ca658d21de0142b43/users/d3589fa1480344cb893f3be9c19d25e4/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:56.193617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:56.203433 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ad2de-89df-4621-acb6-a4fd14149196 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:56.258302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46bba4-84cf-497a-87ee-68cc75136a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:56.258821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46bba4-84cf-497a-87ee-68cc75136a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:56.259094 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46bba4-84cf-497a-87ee-68cc75136a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:56.259396 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46bba4-84cf-497a-87ee-68cc75136a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:56.260018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46bba4-84cf-497a-87ee-68cc75136a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:56.261592 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46bba4-84cf-497a-87ee-68cc75136a57 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:56.271981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1441/2871] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:05:56.276142 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:56.286322 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139bd2a-b874-4aaa-ac39-9d6a474e9875 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:56.291526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:56.292163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:56.292443 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:56.292716 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] PATH_INFO: `/v3/projects/c63399b312ff432ca658d21de0142b43/users/d3589fa1480344cb893f3be9c19d25e4/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:56.294611 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63399b312ff432ca658d21de0142b43, user_id=d3589fa1480344cb893f3be9c19d25e4, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:56.297304 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:56.307272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1431/2872] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:05:56 2022] PUT /identity/v3/projects/c63399b312ff432ca658d21de0142b43/users/d3589fa1480344cb893f3be9c19d25e4/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:05:56.317346 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b1355-9ac8-4eea-9fe6-e218d3b6a7cd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:56.317627 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b1355-9ac8-4eea-9fe6-e218d3b6a7cd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:56.317916 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b1355-9ac8-4eea-9fe6-e218d3b6a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:56.345895 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-634b1355-9ac8-4eea-9fe6-e218d3b6a7cd None None] MFA Rules not processed for user `d3589fa1480344cb893f3be9c19d25e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:05:56.347105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-634b1355-9ac8-4eea-9fe6-e218d3b6a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:56.418018 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1442/2873] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:05:56.428819 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:56.430509 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:05:56.462692 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:05:56.487161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d14e5-fd99-4b71-91c6-065799e3d846 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:56.490887 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:56.491500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:56.491782 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:56.492056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:56.501288 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:56.502709 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:56.512682 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1432/2874] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:56 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:05:56.747527 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b1355-9ac8-4eea-9fe6-e218d3b6a7cd None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:05:56.757847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b1355-9ac8-4eea-9fe6-e218d3b6a7cd None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:05:56.761475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0ede0-1e7f-4de5-90e4-93bc40e0c696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:05:56.762097 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0ede0-1e7f-4de5-90e4-93bc40e0c696 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:05:56.762377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0ede0-1e7f-4de5-90e4-93bc40e0c696 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:05:56.762652 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0ede0-1e7f-4de5-90e4-93bc40e0c696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:05:56.817731 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0ede0-1e7f-4de5-90e4-93bc40e0c696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:05:56.819824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0ede0-1e7f-4de5-90e4-93bc40e0c696 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:05:56.828614 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1443/2875] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:05:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:01.789973 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:01.851763 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ec4d-4dde-4167-ba0d-126160a48eab service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:01.856296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:01.856908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:01.857185 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:01.857454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] PATH_INFO: `/v3/users/6909bb4091784570954a83aa16319e9d` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:01.858564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6909bb4091784570954a83aa16319e9d)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:01.860517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:02.026920 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6909bb4091784570954a83aa16319e9d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.039313 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6909bb4091784570954a83aa16319e9d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.046046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6909bb4091784570954a83aa16319e9d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.046741 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6909bb4091784570954a83aa16319e9d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.047384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6909bb4091784570954a83aa16319e9d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.115496 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1433/2876] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:01 2022] DELETE /identity/v3/users/6909bb4091784570954a83aa16319e9d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:02.120000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863859-7abb-44b3-8331-33a99665f710 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:02.120476 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863859-7abb-44b3-8331-33a99665f710 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:02.120752 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863859-7abb-44b3-8331-33a99665f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:02.140323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-52863859-7abb-44b3-8331-33a99665f710 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:02.141517 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-52863859-7abb-44b3-8331-33a99665f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:02.154521 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=100 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:02.198978 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1444/2877] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:02.209923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:02.211428 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:02.266953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e0550-2acf-4f6d-9c20-f56c57e16d53 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:02.270986 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:02.272105 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:02.272377 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:02.272643 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:02.278515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:02.282069 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:02.283520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:02.293529 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1434/2878] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:06:02.705218 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863859-7abb-44b3-8331-33a99665f710 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:02.706631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-52863859-7abb-44b3-8331-33a99665f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:02.719990 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863859-7abb-44b3-8331-33a99665f710 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:02.724901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:02.725534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:02.725812 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:02.726082 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] PATH_INFO: `/v3/projects/37a1f217c784403b839520791dc6050d` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:02.727249 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a1f217c784403b839520791dc6050d)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:02.730986 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:02.829867 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a1f217c784403b839520791dc6050d', 'request_id': 'req-2c62b381-fa50-4675-9dc7-a11bea1a579b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.835427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a1f217c784403b839520791dc6050d', 'request_id': 'req-2c62b381-fa50-4675-9dc7-a11bea1a579b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.903348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a1f217c784403b839520791dc6050d', 'request_id': 'req-2c62b381-fa50-4675-9dc7-a11bea1a579b'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.914405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] The token cache is being invalidate because project 37a1f217c784403b839520791dc6050d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:02.914685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.915386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:02.916900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1445/2879] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:02 2022] DELETE /identity/v3/projects/37a1f217c784403b839520791dc6050d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:02.920933 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:02.930800 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224c4b-1606-438b-baf5-1604187ac44f service neutron] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:02.987318 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:02.987945 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:02.988224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:02.988498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] PATH_INFO: `/v3/users/d3589fa1480344cb893f3be9c19d25e4` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:02.989618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3589fa1480344cb893f3be9c19d25e4)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:02.992090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:03.162228 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3589fa1480344cb893f3be9c19d25e4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.174262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3589fa1480344cb893f3be9c19d25e4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.182226 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3589fa1480344cb893f3be9c19d25e4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.182899 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3589fa1480344cb893f3be9c19d25e4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.183519 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-fc3eeb64-df73-4d93-8a82-d05864cfe6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3589fa1480344cb893f3be9c19d25e4'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.265539 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1435/2880] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:02 2022] DELETE /identity/v3/users/d3589fa1480344cb893f3be9c19d25e4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:03.700205 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:03.703067 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:03.715364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62b381-fa50-4675-9dc7-a11bea1a579b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:03.773401 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:03.774030 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:03.774310 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:03.774582 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] PATH_INFO: `/v3/projects/c63399b312ff432ca658d21de0142b43` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:03.775720 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63399b312ff432ca658d21de0142b43)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:03.777716 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:03.878826 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:03.881617 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63399b312ff432ca658d21de0142b43', 'request_id': 'req-b5cff80e-00f6-4603-887c-df24f841a416'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.887568 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63399b312ff432ca658d21de0142b43', 'request_id': 'req-b5cff80e-00f6-4603-887c-df24f841a416'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.954650 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63399b312ff432ca658d21de0142b43', 'request_id': 'req-b5cff80e-00f6-4603-887c-df24f841a416'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.966850 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] The token cache is being invalidate because project c63399b312ff432ca658d21de0142b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:03.967130 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.967841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-b5cff80e-00f6-4603-887c-df24f841a416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:03.969306 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1446/2881] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:03 2022] DELETE /identity/v3/projects/c63399b312ff432ca658d21de0142b43 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:03.974176 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df45e-c4ac-4f04-8daf-c149380d00b0 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:03.974668 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df45e-c4ac-4f04-8daf-c149380d00b0 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:03.974790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df45e-c4ac-4f04-8daf-c149380d00b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:03.994163 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-755df45e-c4ac-4f04-8daf-c149380d00b0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:04.000259 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-755df45e-c4ac-4f04-8daf-c149380d00b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:04.054161 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1436/2882] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:04.063118 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd40a-2111-4f65-ac27-b6cd3e796e3c None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.063427 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd40a-2111-4f65-ac27-b6cd3e796e3c None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.063725 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd40a-2111-4f65-ac27-b6cd3e796e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.083843 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-f7fdd40a-2111-4f65-ac27-b6cd3e796e3c None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:04.085033 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-f7fdd40a-2111-4f65-ac27-b6cd3e796e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:04.094050 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1447/2883] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:04.098296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df45e-c4ac-4f04-8daf-c149380d00b0 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:04.108565 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df45e-c4ac-4f04-8daf-c149380d00b0 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:04.113485 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:04.114086 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.114395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.114671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.115382 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:06:04.115688 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:04.117328 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:04.125984 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:04.129264 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1437/2884] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:06:04.134217 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd40a-2111-4f65-ac27-b6cd3e796e3c None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:04.143533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd40a-2111-4f65-ac27-b6cd3e796e3c None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:04.148608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:04.149806 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.150083 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.150352 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.150984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:04.152906 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:04.256309 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1448/2885] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:06:04 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:06:04.260866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:04.271762 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07818c68-1296-4e59-b4b5-b6b2a5b75e04 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:04.325724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:04.326308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.326580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.326845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.327506 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:04.329403 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:04.409551 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1438/2886] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:06:04 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:06:04.413658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:04.424258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086c9f-52fa-4397-85d5-0dd53b15ff08 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:04.429026 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:04.429615 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.430384 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.430694 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.431379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:04.435581 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:04.443195 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1449/2887] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:04.447772 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:04.457852 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a9c9e-a8c8-44b8-b5dd-34dfef043a05 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:04.462684 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdd216-4963-4ec0-ad6a-90c9aee1548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:04.463298 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd216-4963-4ec0-ad6a-90c9aee1548c admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.463577 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd216-4963-4ec0-ad6a-90c9aee1548c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.463850 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd216-4963-4ec0-ad6a-90c9aee1548c admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.464488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdd216-4963-4ec0-ad6a-90c9aee1548c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:04.466065 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdd216-4963-4ec0-ad6a-90c9aee1548c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:04.476389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1439/2888] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:04.480349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:04.490191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf627dd-43af-4ff3-a69a-5d90e7c13a24 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:04.495314 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:04.495956 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.496235 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.496507 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] PATH_INFO: `/v3/projects/6bdaccb3ae4f44a283f4a989c4675a4c/users/3473dcfef5934f31b5293bfb49c5cc40/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.511345 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdaccb3ae4f44a283f4a989c4675a4c, user_id=3473dcfef5934f31b5293bfb49c5cc40, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:04.513969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:04.604226 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1450/2889] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:04 2022] PUT /identity/v3/projects/6bdaccb3ae4f44a283f4a989c4675a4c/users/3473dcfef5934f31b5293bfb49c5cc40/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:04.614581 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf034-1dce-4266-8b87-6af8f981e092 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.614864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf034-1dce-4266-8b87-6af8f981e092 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.615132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf034-1dce-4266-8b87-6af8f981e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.642695 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5e4cf034-1dce-4266-8b87-6af8f981e092 None None] MFA Rules not processed for user `3473dcfef5934f31b5293bfb49c5cc40`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:04.643931 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5e4cf034-1dce-4266-8b87-6af8f981e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:04.707810 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1440/2890] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:04.718390 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:04.720117 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:04.777910 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8617-093d-4df5-97cb-b17b8fe9bc56 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:04.781612 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d78a83-96f1-4d82-9882-c9dd9976c0f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:04.782202 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d78a83-96f1-4d82-9882-c9dd9976c0f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:04.782475 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d78a83-96f1-4d82-9882-c9dd9976c0f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:04.782738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d78a83-96f1-4d82-9882-c9dd9976c0f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:04.791206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d78a83-96f1-4d82-9882-c9dd9976c0f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:04.792641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d78a83-96f1-4d82-9882-c9dd9976c0f1 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:04.801125 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1451/2891] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:08.864785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf034-1dce-4266-8b87-6af8f981e092 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:08.928186 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf034-1dce-4266-8b87-6af8f981e092 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:08.932621 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:08.933236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:08.933517 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:08.933788 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] PATH_INFO: `/v3/users/3473dcfef5934f31b5293bfb49c5cc40` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:08.934888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3473dcfef5934f31b5293bfb49c5cc40)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:08.936847 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:08.948008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:09.111384 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3473dcfef5934f31b5293bfb49c5cc40'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.123778 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3473dcfef5934f31b5293bfb49c5cc40'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.130520 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3473dcfef5934f31b5293bfb49c5cc40'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.131284 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3473dcfef5934f31b5293bfb49c5cc40'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.131896 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3473dcfef5934f31b5293bfb49c5cc40'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.194454 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1441/2892] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:08 2022] DELETE /identity/v3/users/3473dcfef5934f31b5293bfb49c5cc40 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:09.198918 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:09.199435 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:09.199561 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:09.218287 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:09.219512 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:09.276784 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1452/2893] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:09.286370 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:09.287787 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:09.349283 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a7f32-f7e7-4f8d-a456-3d4d9cf67f97 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:09.352970 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0503d-2166-47c4-a055-db6da5589d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:09.353566 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0503d-2166-47c4-a055-db6da5589d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:09.353844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0503d-2166-47c4-a055-db6da5589d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:09.354114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0503d-2166-47c4-a055-db6da5589d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:09.362868 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0503d-2166-47c4-a055-db6da5589d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:09.364326 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0503d-2166-47c4-a055-db6da5589d8b service neutron] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:09.373548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1442/2894] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:09.762167 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:09.763635 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:09.776541 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3d474-3a62-491a-8a99-cea6d667be85 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:09.781196 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:09.781828 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:09.782111 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:09.782382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] PATH_INFO: `/v3/projects/6bdaccb3ae4f44a283f4a989c4675a4c` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:09.783537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdaccb3ae4f44a283f4a989c4675a4c)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:09.785457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:09.794705 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:09.889600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdaccb3ae4f44a283f4a989c4675a4c', 'request_id': 'req-6b1dbd39-2e47-436d-858b-5a05604f2765'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.895244 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdaccb3ae4f44a283f4a989c4675a4c', 'request_id': 'req-6b1dbd39-2e47-436d-858b-5a05604f2765'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.958158 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdaccb3ae4f44a283f4a989c4675a4c', 'request_id': 'req-6b1dbd39-2e47-436d-858b-5a05604f2765'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.969408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] The token cache is being invalidate because project 6bdaccb3ae4f44a283f4a989c4675a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:09.972900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.972900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6b1dbd39-2e47-436d-858b-5a05604f2765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:09.972900 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1453/2895] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:09 2022] DELETE /identity/v3/projects/6bdaccb3ae4f44a283f4a989c4675a4c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:09.976706 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed5c92-72e9-4086-8245-8eb77d91f2de None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:09.977167 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed5c92-72e9-4086-8245-8eb77d91f2de None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:09.977290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed5c92-72e9-4086-8245-8eb77d91f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:09.997343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-60ed5c92-72e9-4086-8245-8eb77d91f2de None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:09.998533 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-60ed5c92-72e9-4086-8245-8eb77d91f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:10.056737 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1443/2896] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:10.064344 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a38d-5a11-4179-aa8c-a3124dc0f1fd None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.064631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a38d-5a11-4179-aa8c-a3124dc0f1fd None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.064905 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a38d-5a11-4179-aa8c-a3124dc0f1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.085442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-3439a38d-5a11-4179-aa8c-a3124dc0f1fd None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:10.086646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-3439a38d-5a11-4179-aa8c-a3124dc0f1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:10.094569 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1454/2897] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:10.098825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed5c92-72e9-4086-8245-8eb77d91f2de None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.109048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed5c92-72e9-4086-8245-8eb77d91f2de None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.113548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.114137 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.114415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.114685 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] PATH_INFO: `/v3/domains` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.115363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81831) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:06:10.115665 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.117261 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:10.129282 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1444/2898] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:06:10.133537 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a38d-5a11-4179-aa8c-a3124dc0f1fd None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.142839 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a38d-5a11-4179-aa8c-a3124dc0f1fd None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.148024 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.148613 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.148889 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.149157 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.149800 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.151758 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:10.233267 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1455/2899] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:06:10 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:10.237424 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.247354 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2a555-9acc-43bc-9187-7edf67b9b422 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.259942 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:10.303721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.304296 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.304572 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.304842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.305467 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.308085 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:10.388216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1445/2900] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:06:10 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:10.392373 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.402846 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375a529-9774-4f14-9b54-ac1af3669b2a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.407788 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.408377 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.408653 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.408922 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.409562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.411143 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:10.425114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1456/2901] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:10.429498 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.440030 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32c04f-276d-463a-a731-1cf675168be5 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.444644 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441f5f9-c4d2-442a-b7c0-ffc6ae30033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.445227 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441f5f9-c4d2-442a-b7c0-ffc6ae30033c admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.445502 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441f5f9-c4d2-442a-b7c0-ffc6ae30033c admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.445770 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441f5f9-c4d2-442a-b7c0-ffc6ae30033c admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.446406 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441f5f9-c4d2-442a-b7c0-ffc6ae30033c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.448103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441f5f9-c4d2-442a-b7c0-ffc6ae30033c admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:10.458415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1446/2902] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:10.462284 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.472114 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1fdd-65cf-41bf-bac8-b52ad3e4e6e9 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.476739 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.477365 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.477646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.478410 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] PATH_INFO: `/v3/projects/fbc4f44914db4e53977af602f12d9453/users/fc5441828a24489a8bf0b1e83a7c6040/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.492558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc4f44914db4e53977af602f12d9453, user_id=fc5441828a24489a8bf0b1e83a7c6040, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.495948 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:10.577560 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1457/2903] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:10 2022] PUT /identity/v3/projects/fbc4f44914db4e53977af602f12d9453/users/fc5441828a24489a8bf0b1e83a7c6040/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:10.589121 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08b3c-7902-4b8e-8225-ad4c1ac6b177 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.589405 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08b3c-7902-4b8e-8225-ad4c1ac6b177 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.589681 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08b3c-7902-4b8e-8225-ad4c1ac6b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.617721 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0aa08b3c-7902-4b8e-8225-ad4c1ac6b177 None None] MFA Rules not processed for user `fc5441828a24489a8bf0b1e83a7c6040`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:10.618925 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0aa08b3c-7902-4b8e-8225-ad4c1ac6b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:10.683164 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1447/2904] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:10.687717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.750001 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebb40-6348-4c05-ab0b-d76622903471 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.754749 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.755364 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.755708 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.755981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.756899 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.758942 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:10.839595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1458/2905] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:06:10 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:06:10.843609 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08b3c-7902-4b8e-8225-ad4c1ac6b177 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:10.854831 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08b3c-7902-4b8e-8225-ad4c1ac6b177 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:10.909112 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:10.909708 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:10.909988 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:10.910262 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:10.910890 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:10.912846 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.027059 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1448/2906] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:06:10 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:11.030951 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.042151 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ad9b-54b5-4644-b073-9e6a056bb853 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.046964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.047601 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.047882 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.048156 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.048794 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.050392 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.061671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1459/2907] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:11.065724 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.078769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4023d7-a920-41e0-8785-373097348c05 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.083944 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5645de5-2d9d-4e24-ae2b-e09d3a37b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.084568 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645de5-2d9d-4e24-ae2b-e09d3a37b1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.084841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645de5-2d9d-4e24-ae2b-e09d3a37b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.085114 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645de5-2d9d-4e24-ae2b-e09d3a37b1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.085744 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5645de5-2d9d-4e24-ae2b-e09d3a37b1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.087923 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5645de5-2d9d-4e24-ae2b-e09d3a37b1c4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.098316 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1449/2908] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:11.102463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.112413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0eb6-4cf7-4a2c-ab6a-eb9511b131c3 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.116995 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.117636 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.117911 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.118177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] PATH_INFO: `/v3/projects/774b6bdc9b594b4b97e7b86a9d4bb3e3/users/8edd5da9781849a4b11d1d59dbf0d886/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.120513 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:11.133047 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=774b6bdc9b594b4b97e7b86a9d4bb3e3, user_id=8edd5da9781849a4b11d1d59dbf0d886, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.136338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.226006 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1460/2909] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:11 2022] PUT /identity/v3/projects/774b6bdc9b594b4b97e7b86a9d4bb3e3/users/8edd5da9781849a4b11d1d59dbf0d886/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:11.236234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c11b6-af7c-48e5-a4cc-d7710125631c None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.236525 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c11b6-af7c-48e5-a4cc-d7710125631c None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.236804 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c11b6-af7c-48e5-a4cc-d7710125631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.245257 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:11.265119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-0b0c11b6-af7c-48e5-a4cc-d7710125631c None None] MFA Rules not processed for user `8edd5da9781849a4b11d1d59dbf0d886`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:11.266337 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-0b0c11b6-af7c-48e5-a4cc-d7710125631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:11.330746 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1450/2910] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:11.335386 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.402482 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ed070-e545-4055-b7e8-51d86cadda4c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.408330 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.408932 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.409209 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.409479 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.410258 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.413969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.536121 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1461/2911] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:06:11 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:11.540184 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c11b6-af7c-48e5-a4cc-d7710125631c None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.552103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c11b6-af7c-48e5-a4cc-d7710125631c None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.608388 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646db796-604b-4496-9341-da51658ff849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.608990 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db796-604b-4496-9341-da51658ff849 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.609270 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db796-604b-4496-9341-da51658ff849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.609540 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db796-604b-4496-9341-da51658ff849 admin admin] PATH_INFO: `/v3/users` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.610159 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646db796-604b-4496-9341-da51658ff849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.612104 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646db796-604b-4496-9341-da51658ff849 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.687054 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1451/2912] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:06:11 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:11.691000 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.701925 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fd2d8-d37f-4e8b-b29c-32c029230952 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.706573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.707177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.707463 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.707771 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.708375 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.709964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.720331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1462/2913] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:11.724515 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646db796-604b-4496-9341-da51658ff849 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.734935 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646db796-604b-4496-9341-da51658ff849 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.739666 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.740302 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.740579 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.740851 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] PATH_INFO: `/v3/projects/dcee60cfc95d43a3b7b566e44975c041/users/206a8be11f424f38b1f34db3f550e419/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.757535 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcee60cfc95d43a3b7b566e44975c041, user_id=206a8be11f424f38b1f34db3f550e419, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.760247 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.824308 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1452/2914] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:11 2022] PUT /identity/v3/projects/dcee60cfc95d43a3b7b566e44975c041/users/206a8be11f424f38b1f34db3f550e419/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:11.828321 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.838265 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f992c-c94e-49ba-ad1a-091e126a90a7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.895368 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff15b93-2851-4609-9262-f21d3db1dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.895960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff15b93-2851-4609-9262-f21d3db1dc5e admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.896234 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff15b93-2851-4609-9262-f21d3db1dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.896501 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff15b93-2851-4609-9262-f21d3db1dc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.897123 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff15b93-2851-4609-9262-f21d3db1dc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.898738 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff15b93-2851-4609-9262-f21d3db1dc5e admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.908105 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1463/2915] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:11.912351 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:11.922898 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84a332-fd80-4c41-89ad-150249563c44 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:11.927464 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:11.928093 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.928363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.928628 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] PATH_INFO: `/v3/projects/dcee60cfc95d43a3b7b566e44975c041/users/206a8be11f424f38b1f34db3f550e419/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.930488 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcee60cfc95d43a3b7b566e44975c041, user_id=206a8be11f424f38b1f34db3f550e419, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:11.933736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:11.943542 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1453/2916] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:11 2022] PUT /identity/v3/projects/dcee60cfc95d43a3b7b566e44975c041/users/206a8be11f424f38b1f34db3f550e419/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:11.954429 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:11.954717 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:11.955015 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:11.982562 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] MFA Rules not processed for user `206a8be11f424f38b1f34db3f550e419`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:11.983797 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:12.024520 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:12.050544 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1464/2917] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:12.062325 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:12.064048 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:12.118008 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:12.123690 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18891b0-f91c-4356-bb9a-4d452b4132b4 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:12.127369 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:12.127967 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:12.128291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:12.128588 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:12.184043 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:12.185395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:12.194366 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1454/2918] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:14.082610 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:14.084021 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:14.095975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52d134-c814-469a-a548-049feb3c9f61 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:14.099643 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:14.100115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:14.100393 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:14.100663 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:14.156397 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:14.157753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:14.167023 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1465/2919] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:15.462748 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:15.471892 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad81cb-4292-4c24-9f13-eb44c556ddc3 service cinder] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:15.475493 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfc67c-72e4-4487-bff4-1aaa733aad2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:15.476082 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfc67c-72e4-4487-bff4-1aaa733aad2a service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:15.476360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfc67c-72e4-4487-bff4-1aaa733aad2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:15.476633 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfc67c-72e4-4487-bff4-1aaa733aad2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:15.485360 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfc67c-72e4-4487-bff4-1aaa733aad2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:15.486771 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfc67c-72e4-4487-bff4-1aaa733aad2a service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:15.496034 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1455/2920] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:20.203651 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:20.265824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892810-8703-46ce-be36-3a1218df92d2 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:20.270680 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:20.271328 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:20.271605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:20.271877 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] PATH_INFO: `/v3/users/fc5441828a24489a8bf0b1e83a7c6040` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:20.272989 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5441828a24489a8bf0b1e83a7c6040)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:20.274919 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:20.439506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5441828a24489a8bf0b1e83a7c6040'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:20.440096 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5441828a24489a8bf0b1e83a7c6040'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:20.446746 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5441828a24489a8bf0b1e83a7c6040'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:20.520339 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5441828a24489a8bf0b1e83a7c6040'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:20.531534 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:20.532700 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5441828a24489a8bf0b1e83a7c6040'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:20.538459 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1466/2921] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:20 2022] DELETE /identity/v3/users/fc5441828a24489a8bf0b1e83a7c6040 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:20.543056 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:20.543618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:20.543618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:20.563538 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:20.564743 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:20.622843 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1456/2922] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:20.632424 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:20.633862 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:20.696493 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7c30-a069-4c85-97bc-53ce14d4d219 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:20.697003 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:20.697605 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:20.697887 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:20.698160 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:20.707064 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:20.708567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:20.718020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1467/2923] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:21.111248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:21.112713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:21.126166 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4025e1-f90d-403a-8fee-b6dabe45df71 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:21.130871 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:21.131546 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:21.131825 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:21.132100 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] PATH_INFO: `/v3/projects/fbc4f44914db4e53977af602f12d9453` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:21.133290 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc4f44914db4e53977af602f12d9453)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:21.135149 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:21.231656 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc4f44914db4e53977af602f12d9453', 'request_id': 'req-4b100428-f93c-462e-a58a-003d65c753ec'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.237775 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc4f44914db4e53977af602f12d9453', 'request_id': 'req-4b100428-f93c-462e-a58a-003d65c753ec'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.280079 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc4f44914db4e53977af602f12d9453', 'request_id': 'req-4b100428-f93c-462e-a58a-003d65c753ec'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.290331 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] The token cache is being invalidate because project fbc4f44914db4e53977af602f12d9453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:21.291630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.291630 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.293460 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1457/2924] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:21 2022] DELETE /identity/v3/projects/fbc4f44914db4e53977af602f12d9453 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:21.297685 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:21.307732 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae39ca4-97c7-4985-945c-eef9dc128657 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:21.363437 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:21.364057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:21.364336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:21.364608 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] PATH_INFO: `/v3/users/8edd5da9781849a4b11d1d59dbf0d886` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:21.365726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edd5da9781849a4b11d1d59dbf0d886)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:21.368031 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:21.516893 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edd5da9781849a4b11d1d59dbf0d886'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.517600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edd5da9781849a4b11d1d59dbf0d886'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.524950 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edd5da9781849a4b11d1d59dbf0d886'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.585886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edd5da9781849a4b11d1d59dbf0d886'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.599007 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edd5da9781849a4b11d1d59dbf0d886'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:21.604939 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1468/2925] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:21 2022] DELETE /identity/v3/users/8edd5da9781849a4b11d1d59dbf0d886 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:21.999720 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:22.001145 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:22.016888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100428-f93c-462e-a58a-003d65c753ec admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:22.025507 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:22.073080 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:22.074254 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:22.074526 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:22.074792 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] PATH_INFO: `/v3/projects/774b6bdc9b594b4b97e7b86a9d4bb3e3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:22.075950 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=774b6bdc9b594b4b97e7b86a9d4bb3e3)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:22.077840 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:22.204545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774b6bdc9b594b4b97e7b86a9d4bb3e3', 'request_id': 'req-1929e550-fe25-40b2-9562-4cdf60fb8b3e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.210648 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774b6bdc9b594b4b97e7b86a9d4bb3e3', 'request_id': 'req-1929e550-fe25-40b2-9562-4cdf60fb8b3e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.285745 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774b6bdc9b594b4b97e7b86a9d4bb3e3', 'request_id': 'req-1929e550-fe25-40b2-9562-4cdf60fb8b3e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.296844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] The token cache is being invalidate because project 774b6bdc9b594b4b97e7b86a9d4bb3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:22.297132 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.297758 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.299274 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1458/2926] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:21 2022] DELETE /identity/v3/projects/774b6bdc9b594b4b97e7b86a9d4bb3e3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:22.304098 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:22.305052 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:22.318625 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b32dfa-0632-418a-b3e5-97f874bae6c2 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:22.336081 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:22.373944 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:22.374558 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:22.374833 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:22.375101 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] PATH_INFO: `/v3/users/206a8be11f424f38b1f34db3f550e419` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:22.376275 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] RBAC: Authorizing `identity:delete_user(user_id=206a8be11f424f38b1f34db3f550e419)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:22.378264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:22.582333 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206a8be11f424f38b1f34db3f550e419'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.583856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206a8be11f424f38b1f34db3f550e419'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.591290 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206a8be11f424f38b1f34db3f550e419'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.660671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206a8be11f424f38b1f34db3f550e419'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.673442 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-66290638-25c1-470b-af7c-465cd6e307af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206a8be11f424f38b1f34db3f550e419'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:22.679324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1469/2927] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:22 2022] DELETE /identity/v3/users/206a8be11f424f38b1f34db3f550e419 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:06:23.090895 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:23.092419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:23.106119 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929e550-fe25-40b2-9562-4cdf60fb8b3e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:23.163122 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:23.163713 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.163989 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.164258 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] PATH_INFO: `/v3/projects/dcee60cfc95d43a3b7b566e44975c041` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.165362 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcee60cfc95d43a3b7b566e44975c041)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:23.167796 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:23.248864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:23.252731 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcee60cfc95d43a3b7b566e44975c041', 'request_id': 'req-f237be32-9003-49fe-950b-9a82a3a9146e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:23.258790 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcee60cfc95d43a3b7b566e44975c041', 'request_id': 'req-f237be32-9003-49fe-950b-9a82a3a9146e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:23.308844 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcee60cfc95d43a3b7b566e44975c041', 'request_id': 'req-f237be32-9003-49fe-950b-9a82a3a9146e'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:23.319534 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] The token cache is being invalidate because project dcee60cfc95d43a3b7b566e44975c041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:23.320009 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:23.321096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-f237be32-9003-49fe-950b-9a82a3a9146e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:23.322675 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1459/2928] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:23 2022] DELETE /identity/v3/projects/dcee60cfc95d43a3b7b566e44975c041 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:23.327821 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420c6c-5683-4be4-b196-a8f9da8c66d0 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.328323 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420c6c-5683-4be4-b196-a8f9da8c66d0 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.328438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420c6c-5683-4be4-b196-a8f9da8c66d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.348983 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-87420c6c-5683-4be4-b196-a8f9da8c66d0 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:23.350198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-87420c6c-5683-4be4-b196-a8f9da8c66d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:23.409712 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1470/2929] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:23.418169 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a16a2-0ea7-442c-949d-b5b7d29b4c57 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.418395 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a16a2-0ea7-442c-949d-b5b7d29b4c57 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.418667 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a16a2-0ea7-442c-949d-b5b7d29b4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.439240 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-cb6a16a2-0ea7-442c-949d-b5b7d29b4c57 None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:23.440457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-cb6a16a2-0ea7-442c-949d-b5b7d29b4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:23.448383 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1460/2930] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:23.452646 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87420c6c-5683-4be4-b196-a8f9da8c66d0 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:23.462405 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87420c6c-5683-4be4-b196-a8f9da8c66d0 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:23.469972 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:23.470728 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.471008 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.471316 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.471962 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:06:23.472259 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:23.473851 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:23.486264 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1471/2931] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 1 17:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:06:23.490623 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a16a2-0ea7-442c-949d-b5b7d29b4c57 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:23.499848 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a16a2-0ea7-442c-949d-b5b7d29b4c57 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:23.504480 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:23.505066 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.505345 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.505618 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.506244 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:23.508198 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:23.581959 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1461/2932] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:06:23 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:23.585595 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:23.596038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27e44e-0ff3-45dc-b667-d8ee34e21de7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:23.616182 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:23.652133 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:23.652741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.653020 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.653372 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.654017 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:23.655960 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:23.757747 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1472/2933] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:06:23 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:06:23.762272 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:23.773097 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1faba-62c8-4f56-9c5c-056db8f55fc5 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:23.778423 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:23.779127 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.779434 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.779705 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.780342 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:23.781916 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:23.791995 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1462/2934] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:23.795769 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:23.805583 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b621-1938-4bfa-8fa0-f2b09b2d563a admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:23.810408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4dabf-9eb5-4634-a7b3-4bf2efb1bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:23.810984 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4dabf-9eb5-4634-a7b3-4bf2efb1bfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.811302 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4dabf-9eb5-4634-a7b3-4bf2efb1bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.811573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4dabf-9eb5-4634-a7b3-4bf2efb1bfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.812206 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4dabf-9eb5-4634-a7b3-4bf2efb1bfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:23.813841 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4dabf-9eb5-4634-a7b3-4bf2efb1bfc9 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:23.826216 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1473/2935] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:23.830236 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:23.840769 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718930-eeb3-4b31-b11a-38eab470c611 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:23.845922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:23.846564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:23.846842 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:23.847115 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] PATH_INFO: `/v3/projects/bec109caeb3a4682af583fac8a66bf44/users/ac413590ee7a47cab349ea2c5b955933/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:23.863740 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec109caeb3a4682af583fac8a66bf44, user_id=ac413590ee7a47cab349ea2c5b955933, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:23.866453 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:23.992797 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1463/2936] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:23 2022] PUT /identity/v3/projects/bec109caeb3a4682af583fac8a66bf44/users/ac413590ee7a47cab349ea2c5b955933/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:24.003408 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93c3c4-83d8-4bef-b64c-150f0e23b26a None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.003817 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93c3c4-83d8-4bef-b64c-150f0e23b26a None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.004191 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93c3c4-83d8-4bef-b64c-150f0e23b26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.033280 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-cd93c3c4-83d8-4bef-b64c-150f0e23b26a None None] MFA Rules not processed for user `ac413590ee7a47cab349ea2c5b955933`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:24.037406 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-cd93c3c4-83d8-4bef-b64c-150f0e23b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:24.099975 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1474/2937] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:24.104470 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:24.167634 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd70895-d29f-46aa-ba41-d3a544867e3f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:24.172216 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:24.172812 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.173096 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.173365 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.173992 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:24.175939 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:24.250389 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1464/2938] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:06:24 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:24.254600 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93c3c4-83d8-4bef-b64c-150f0e23b26a None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:24.265776 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93c3c4-83d8-4bef-b64c-150f0e23b26a None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:24.320671 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:24.321198 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.321473 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.321743 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.322361 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:24.324928 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:24.408599 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1475/2939] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:06:24 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:24.412564 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:24.423803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70989c-416a-4e17-bd8c-2e1d2bcbb098 admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:24.428436 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:24.429026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.429305 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.429580 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.430220 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:24.431932 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:24.443419 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1465/2940] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:24.447239 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:24.457461 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91e100-80f4-4462-b1ae-4233f4927825 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:24.462038 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9b1e4-b828-4a0e-b191-180e5de5b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:24.462623 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b1e4-b828-4a0e-b191-180e5de5b48a admin admin] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.462901 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b1e4-b828-4a0e-b191-180e5de5b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.463201 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b1e4-b828-4a0e-b191-180e5de5b48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.463847 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9b1e4-b828-4a0e-b191-180e5de5b48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:24.465417 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9b1e4-b828-4a0e-b191-180e5de5b48a admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:24.475074 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1476/2941] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:24.478918 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:24.489214 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11762f21-a947-4b4b-b3f2-fd5fdd91a91f admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:24.494018 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:24.494647 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.495590 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.495880 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] PATH_INFO: `/v3/projects/16612e94bb1f4ae1bdb3be4f1866a8f3/users/173833624d1d4f3d8661d15ebf1dd5df/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.509864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=16612e94bb1f4ae1bdb3be4f1866a8f3, user_id=173833624d1d4f3d8661d15ebf1dd5df, role_id=e1bba7bbffcd4619ac75e36b0e8ac3a7)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:24.512562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:24.606449 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1466/2942] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:24 2022] PUT /identity/v3/projects/16612e94bb1f4ae1bdb3be4f1866a8f3/users/173833624d1d4f3d8661d15ebf1dd5df/roles/e1bba7bbffcd4619ac75e36b0e8ac3a7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:24.617573 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e329-5e27-4ce7-adae-d4644d9b4486 None None] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.617856 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e329-5e27-4ce7-adae-d4644d9b4486 None None] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.618128 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e329-5e27-4ce7-adae-d4644d9b4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.639115 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:24.646713 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.auth.core [None req-18f9e329-5e27-4ce7-adae-d4644d9b4486 None None] MFA Rules not processed for user `173833624d1d4f3d8661d15ebf1dd5df`. Rule list: `[]` (Enabled: `True`). {{(pid=81830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:24.647970 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-18f9e329-5e27-4ce7-adae-d4644d9b4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:24.711349 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1477/2943] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:24.715832 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:24.735532 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:24.778595 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea538e1-a08a-48d0-b81b-f9eef48644fd admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:24.783368 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:24.783963 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.784241 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.784512 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.785197 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:24.787500 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:24.864189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1467/2944] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 1 17:06:24 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:24.871921 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e329-5e27-4ce7-adae-d4644d9b4486 None None] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:24.882631 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e329-5e27-4ce7-adae-d4644d9b4486 None None] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:24.937469 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:24.938060 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:24.938338 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:24.938604 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] PATH_INFO: `/v3/users` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:24.939256 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:24.941164 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:25.020805 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1478/2945] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 1 17:06:24 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:06:25.024785 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:25.035732 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280fb27-aa42-446e-8755-60bde8af06ed admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:25.040452 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:25.041044 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:25.041343 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:25.041598 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:25.042864 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:25.044508 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:25.054888 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1468/2946] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:25.060931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:25.070824 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1202-def5-4d3d-a03d-66d3fe516af7 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:25.075438 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:25.076072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:25.076348 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:25.076619 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] PATH_INFO: `/v3/projects/5a0c0aff1b014d45a142f4c90050eb7d/users/ad4825f55f1e47bd8b2a7dcfe2bc5183/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:25.091563 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0c0aff1b014d45a142f4c90050eb7d, user_id=ad4825f55f1e47bd8b2a7dcfe2bc5183, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:25.094194 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:25.158072 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1479/2947] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:25 2022] PUT /identity/v3/projects/5a0c0aff1b014d45a142f4c90050eb7d/users/ad4825f55f1e47bd8b2a7dcfe2bc5183/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:06:25.161953 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:25.172736 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57130cba-195f-4be3-b818-a02af188843e admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:25.228041 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eea90-b0ec-4c0c-802e-af9f786b16e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:25.228635 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eea90-b0ec-4c0c-802e-af9f786b16e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:25.228912 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eea90-b0ec-4c0c-802e-af9f786b16e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:25.229189 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eea90-b0ec-4c0c-802e-af9f786b16e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:25.229841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eea90-b0ec-4c0c-802e-af9f786b16e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:25.231450 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eea90-b0ec-4c0c-802e-af9f786b16e3 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:25.241103 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1469/2948] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 1 17:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:06:25.245192 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:25.255279 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2b515-d695-4190-a99f-58fe334e60e5 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:25.259964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:25.261106 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:25.261379 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:25.261644 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] PATH_INFO: `/v3/projects/5a0c0aff1b014d45a142f4c90050eb7d/users/ad4825f55f1e47bd8b2a7dcfe2bc5183/roles/30b5862c5d6a491b8aa1bb162c62bf6a` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:25.263585 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0c0aff1b014d45a142f4c90050eb7d, user_id=ad4825f55f1e47bd8b2a7dcfe2bc5183, role_id=30b5862c5d6a491b8aa1bb162c62bf6a)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:25.266240 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:25.277380 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1480/2949] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 1 17:06:25 2022] PUT /identity/v3/projects/5a0c0aff1b014d45a142f4c90050eb7d/users/ad4825f55f1e47bd8b2a7dcfe2bc5183/roles/30b5862c5d6a491b8aa1bb162c62bf6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:25.287224 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:25.287510 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:25.287777 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:25.314143 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] MFA Rules not processed for user `ad4825f55f1e47bd8b2a7dcfe2bc5183`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:25.315385 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:25.381002 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1470/2950] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:25.392879 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:25.394803 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:25.454483 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f5cc-699b-4e33-bb96-2a344618fc2c admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:25.458658 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:25.459297 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:25.459577 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:25.459967 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:25.467126 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:25.519057 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:25.520764 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:25.530441 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1481/2951] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:26.802981 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:26.804457 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:26.826291 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:26.904363 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a02b-2f2f-4fb5-99b0-dcba7a154225 None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:26.909292 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:26.909902 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:26.910173 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:26.910445 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:26.912196 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:26.923982 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:26.925548 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:26.935897 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1471/2952] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:27.528931 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:27.530965 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:27.543462 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b0b56-49c7-4cd8-87ee-641bc46ed907 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:27.547177 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:27.547819 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:27.550641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:27.550641 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:27.604472 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:27.605943 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:27.614748 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1482/2953] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:29.209208 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:29.219117 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ff25-0603-41b2-a080-386fa7b7085b service placement] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:29.222653 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b871ea1-5d67-4870-8d3c-6fc897884bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a7af0d09114d14a22cdb8291fe8b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:29.223267 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b871ea1-5d67-4870-8d3c-6fc897884bda service cinder] REQUEST_METHOD: `GET` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:29.223545 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b871ea1-5d67-4870-8d3c-6fc897884bda service cinder] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:29.223815 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b871ea1-5d67-4870-8d3c-6fc897884bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:29.232687 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b871ea1-5d67-4870-8d3c-6fc897884bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:29.234101 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b871ea1-5d67-4870-8d3c-6fc897884bda service cinder] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:29.243418 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1472/2954] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:33.809745 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:33.870453 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6863-6fd9-47b4-b004-9f8861de97d2 service cinder] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:33.875518 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:33.876139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:33.876420 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:33.876691 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] PATH_INFO: `/v3/users/ac413590ee7a47cab349ea2c5b955933` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:33.877810 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac413590ee7a47cab349ea2c5b955933)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:33.879762 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:34.060324 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac413590ee7a47cab349ea2c5b955933'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:34.060964 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac413590ee7a47cab349ea2c5b955933'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:34.062175 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:34.068354 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac413590ee7a47cab349ea2c5b955933'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:34.180180 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac413590ee7a47cab349ea2c5b955933'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:34.192831 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac413590ee7a47cab349ea2c5b955933'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:34.198515 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1483/2955] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:33 2022] DELETE /identity/v3/users/ac413590ee7a47cab349ea2c5b955933 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:34.204697 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] REQUEST_METHOD: `POST` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:34.205327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:34.205327 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:34.229148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.auth.core [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] MFA Rules not processed for user `767c0fa425fc4873b22c5fadbfb7d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81831) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:06:34.229148 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:34.283885 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1473/2956] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 1 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:06:34.293907 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:34.295382 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:34.353432 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949ae97-043e-4242-a654-a0785d0e0d00 admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:34.357543 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94c7e57c93dd49a1a3e784002ae94fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:34.358139 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:34.358413 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:34.358681 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:34.367497 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:34.368913 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:34.378753 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1484/2957] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:06:34.775922 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:34.777909 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:34.789908 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d174-af63-4c77-a7ab-4ad59c0404bc None None] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:34.795205 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:34.795962 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:34.796234 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:34.796501 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] PATH_INFO: `/v3/projects/bec109caeb3a4682af583fac8a66bf44` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:34.797632 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec109caeb3a4682af583fac8a66bf44)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:34.799562 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:34.936269 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec109caeb3a4682af583fac8a66bf44', 'request_id': 'req-a97f35b8-f114-4f4e-b015-82d077af5c8d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:34.942310 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec109caeb3a4682af583fac8a66bf44', 'request_id': 'req-a97f35b8-f114-4f4e-b015-82d077af5c8d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.016691 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec109caeb3a4682af583fac8a66bf44', 'request_id': 'req-a97f35b8-f114-4f4e-b015-82d077af5c8d'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.021075 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:35.028655 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] The token cache is being invalidate because project bec109caeb3a4682af583fac8a66bf44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:35.028941 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.029575 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.031053 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1474/2958] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:34 2022] DELETE /identity/v3/projects/bec109caeb3a4682af583fac8a66bf44 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:35.035886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:35.044741 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126f955-908b-4cec-ac8f-45f84a9e20b5 service neutron] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:35.099969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:35.100587 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:35.100861 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:35.101178 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] PATH_INFO: `/v3/users/173833624d1d4f3d8661d15ebf1dd5df` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:35.102299 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=173833624d1d4f3d8661d15ebf1dd5df)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:35.104293 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:35.282742 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173833624d1d4f3d8661d15ebf1dd5df'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.283429 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173833624d1d4f3d8661d15ebf1dd5df'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.290422 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173833624d1d4f3d8661d15ebf1dd5df'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.359533 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173833624d1d4f3d8661d15ebf1dd5df'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.365022 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:35.372446 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173833624d1d4f3d8661d15ebf1dd5df'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.378331 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1485/2959] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:35 2022] DELETE /identity/v3/users/173833624d1d4f3d8661d15ebf1dd5df => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:35.778567 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:35.780046 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:35.793671 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f35b8-f114-4f4e-b015-82d077af5c8d admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:35.850026 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:35.850573 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:35.850845 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:35.851112 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] PATH_INFO: `/v3/projects/16612e94bb1f4ae1bdb3be4f1866a8f3` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:35.852248 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] RBAC: Authorizing `identity:delete_project(project_id=16612e94bb1f4ae1bdb3be4f1866a8f3)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:35.854138 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:35.953221 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16612e94bb1f4ae1bdb3be4f1866a8f3', 'request_id': 'req-a638115f-eb1f-4d6f-8f99-58208d95349b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:35.959503 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16612e94bb1f4ae1bdb3be4f1866a8f3', 'request_id': 'req-a638115f-eb1f-4d6f-8f99-58208d95349b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.028673 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16612e94bb1f4ae1bdb3be4f1866a8f3', 'request_id': 'req-a638115f-eb1f-4d6f-8f99-58208d95349b'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.039090 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] The token cache is being invalidate because project 16612e94bb1f4ae1bdb3be4f1866a8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:36.039407 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.040033 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.041543 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1475/2960] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:35 2022] DELETE /identity/v3/projects/16612e94bb1f4ae1bdb3be4f1866a8f3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:36.046091 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:36.047578 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:36.060909 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2820-8e0b-4546-b644-2591ecedb65b admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:36.116726 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:36.117347 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:36.117620 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:36.117886 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] PATH_INFO: `/v3/users/ad4825f55f1e47bd8b2a7dcfe2bc5183` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:36.118991 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4825f55f1e47bd8b2a7dcfe2bc5183)` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:36.120954 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:36.302934 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4825f55f1e47bd8b2a7dcfe2bc5183'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.303969 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4825f55f1e47bd8b2a7dcfe2bc5183'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.311272 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4825f55f1e47bd8b2a7dcfe2bc5183'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.386506 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4825f55f1e47bd8b2a7dcfe2bc5183'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.398768 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.notifications [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4825f55f1e47bd8b2a7dcfe2bc5183'} {{(pid=81830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.405336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1486/2961] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 1 17:06:36 2022] DELETE /identity/v3/users/ad4825f55f1e47bd8b2a7dcfe2bc5183 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:36.798536 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Authenticating user token {{(pid=81831) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:06:36.800087 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.fernet_utils [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81831) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:06:36.815841 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638115f-eb1f-4d6f-8f99-58208d95349b admin admin] Validating token access rules against request {{(pid=81831) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:06:36.874458 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767c0fa425fc4873b22c5fadbfb7d673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17429cdb686a41f6a3cf51eb7ac21844', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81831) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:06:36.875094 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:06:36.875409 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:06:36.875683 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] PATH_INFO: `/v3/projects/5a0c0aff1b014d45a142f4c90050eb7d` {{(pid=81831) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:06:36.876803 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0c0aff1b014d45a142f4c90050eb7d)` {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:06:36.878714 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] RBAC: Authorization granted {{(pid=81831) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:06:36.969828 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:36.985309 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0c0aff1b014d45a142f4c90050eb7d', 'request_id': 'req-657c499f-6ded-4586-968b-742a76da3c98'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:36.991295 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0c0aff1b014d45a142f4c90050eb7d', 'request_id': 'req-657c499f-6ded-4586-968b-742a76da3c98'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:37.059839 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0c0aff1b014d45a142f4c90050eb7d', 'request_id': 'req-657c499f-6ded-4586-968b-742a76da3c98'} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:37.070415 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] The token cache is being invalidate because project 5a0c0aff1b014d45a142f4c90050eb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81831) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:06:37.070704 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:37.071387 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG keystone.notifications [None req-657c499f-6ded-4586-968b-742a76da3c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81831) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:06:37.072866 dv-cinder-852210-9-smb devstack@keystone.service[81831]: [pid: 81831|app: 0|req: 1476/2962] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 1 17:06:36 2022] DELETE /identity/v3/projects/5a0c0aff1b014d45a142f4c90050eb7d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:06:46.401336 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=58,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:06:47.117414 dv-cinder-852210-9-smb devstack@keystone.service[81831]: DEBUG dbcounter [-] [81831] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:11:31.830760 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Authenticating user token {{(pid=81830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:11:31.832291 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:11:31.901624 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89a431-711e-4d92-a1d5-5e92937b092f admin admin] Validating token access rules against request {{(pid=81830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:11:31.959666 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df553dc-92fb-4124-ae46-8dec7e1b8d2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9bc79bd5c8149679d8d7f85095e5be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f49e0bb6358e44ef93862d3cf244efc4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:11:31.960261 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df553dc-92fb-4124-ae46-8dec7e1b8d2d service placement] REQUEST_METHOD: `GET` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:11:31.960549 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df553dc-92fb-4124-ae46-8dec7e1b8d2d service placement] SCRIPT_NAME: `/identity` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:11:31.960807 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df553dc-92fb-4124-ae46-8dec7e1b8d2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:11:31.962567 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.fernet_utils [None req-6df553dc-92fb-4124-ae46-8dec7e1b8d2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:11:31.974080 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df553dc-92fb-4124-ae46-8dec7e1b8d2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:11:31.975981 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df553dc-92fb-4124-ae46-8dec7e1b8d2d service placement] RBAC: Authorization granted {{(pid=81830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:11:31.985457 dv-cinder-852210-9-smb devstack@keystone.service[81830]: [pid: 81830|app: 0|req: 1487/2963] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 1 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:11:41.981329 dv-cinder-852210-9-smb devstack@keystone.service[81830]: DEBUG dbcounter [-] [81830] Writing DB stats keystone:SELECT=58 {{(pid=81830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}